g, that does sound weird. Being the psych major that I am, however, I put some thought into this.
Maybe he was just as shocked to see/recognize you as you were to see him, and it was weird for him to have a fan and his wife in the same place. He could have thought you were going to say something to him and didn't want to have to bring his wife into it. He does tend to keep his private life and his professional life separate; for all the interviews he does, he only mentions his wife in passing.
Or he just thinks you're stalking him and was considering his nearest escape route.
Like a firework unexploded
Wanting life but never
knowing how