I don't think Andy is so bad. I think he knows that these people are just awful to the core, but in the game, he tries to ignore that and play to his advantage. Sure, I'd love for him to stick up for himself and others, but the consequence could be his downfall.
BIG BROTHER, and other reality game shows, are tricky. On one hand, you want to be yourself, and on the other hand you need to alter yourself to cater to your gameplay. Andy associates himself with everyone, and he chose an alliance with the villains. Does that make him one? No. But I can see how some viewers are annoyed by his cowardess.
"The Spectacle has, indeed, an emotional attraction of its own, but, of all the parts, it is the least artistic, and connected least with the art of poetry. For the power of Tragedy, we may be sure, is felt even apart from representation and actors. Besides, the production of spectacular effects depends more on the art of the stage machinist than on that of the poet."
--Aristotle