Yes, I used to feel that way a lot. I think I finally began to outgrow it after the age of 30, but that's when I realized that I was actually much happier when I just avoided other people altogether and kept to myself.
Nearly twenty years after that I discovered AS, was diagnosed and suddenly it all made sense.
Adopting some of the attitudes of Zen Buddhism in my mid-late twenties helped a lot, too. It helped me not to take everything in my life quite so seriously and not get so bent about things I couldn't control.
Its that 'I MUST be prepared for everything - No Surprises Allowed' aspect of AS that I think causes us to feel that way in dealings with others. We want everything to be predictable and orderly, so we don't get overwhelmed - and emotions are particularly overwhelming.
Truth be told, though, if I you could program everybody around you like robots so they always did things exactly the way you expected them to, things would get really boring in a hurry.