It just sucks for people who go specifically for a certain actor and they never get to meet them if they wanted I hope this is just an error in your phrasing and not your actual implication, but if
that's why someone is going to a show, then they have a problem. Yeah, it sucks not to get to meet someone when you've got your hopes up and they're your favorite, but actors are people too, carrying a musical is extremely tiring, and so forth into all the things that have been said every time someone sparks this debate.
As erinrebecca said, Adam will be pretty hit and miss. If you do get to meet him, he's great, but he isn't very comfortable with the clamoring and chaos that can go on when you do the stage door thing. Also, his family is still based in LA, so they come to visit sometimes -- it's completely possible that he has been heading home quickly to spend time with them while he can. I can't imagine having your kids on the other side of the country and only seeing them every few months is easy.
A work of art is an invitation to love.