People usually can't tell whether you're looking in their eyes or not when you look generally at their face.
For the other stuff, you may have been giving off body language that for NTs would mean one thing, but for you meant another. It sounds like she observed nonverbal behavior she was familiar with, and interpreted it in the usual way. You might have to explain to her that although your body language was saying one thing, you were feeling another.
For me, I always have a problem with people thinking I'm anxious when I'm not, because I speak quickly and make poor eye contact, which for NTs are signs of anxiety. It's annoying, but it's not fair for me to assume that other people will understand that while in *most* people that behavior means anxiety, for me it is just status quo, unless I actually tell them.
_________________
Not all those who wander are lost... but I generally am.