I do the lip reading thing, too, which seems to work OK for whoever I'm talking to, they only begin to appear concerned if I start looking someplace other than their face. It also helps me understand what they are saying, which can be hard if I'm not looking at their lips-- auditory processing issues. I became aware of this long before I knew about asperger's, and I thought it was weird, and I tried to make myself look in people's eyes, but I couldn't figure out how to do it properly. If I just stare at their eyes, they seem to get distressed. I read once that most people look each other in the eye, with brief glances away from the eyes several times at minute. So I tried that, which really didn't work, I couldn't even hear what they were saying, I was too focused on trying to get the eye contact right, and they would start to get that look they get when they think I'm extremely weird. So I went back to my usual lip reading, with no further problems.
I can't look at people at all sometimes if I don't like them, or if I'm upset at them. This has gotten a lot of comments from folks. NT's hate this. It really freaks them out, but it is so hard to look at someone if I don't like them.
_________________
"The measure of a man's estimate of your strength is the kind of weapons he feels that he must use in order to hold you fast in a prescribed place." Howard Thurman