Apparently while in conversation you're supposed to maintain eye contact for like, 5 seconds, then, if you're continuing the conversation, you look up and to the right or left. Down means you're not interested/ending the conversation.
I know, it's a pain to have to remember this and do all of it during a conversation, and just trying to learn to do it makes you miss more than you would if they were just annoyed with you.
Personally I don't like eye contact, I make it, but I think I maintain it for too long. One good piece of advice is to look at their nose, or their mouth. Conversations are such a pain in the ass. I've started just telling people that "just because I'm not looking at you doesn't mean I'm not listening" and usually they can accept that.
Unfortunately, as I know all too well, just being who you are is going to get you weird looks, and there isn't much you can do to stop that. Eye contact just gives them an excuse.
Good luck Charles, it really does suck, but like I said, explain that you listen better without looking at them, and if they're people worth talking to they should be willing to accept that. Maybe continue to make occasional eye contact.
_________________
Someone who's only willing to give you a penny for your thoughts isn't worth your time.
Aspie Score: 170 of 200
NT Score: 37 of 200