Yeah, I know how you feel. We aspies tend not to be too social, don't take it personally. Like you said we don't fit in, so naturally we tend to be anti-social because all the people who are normal and social will not accept us, and many discourage us from being accepted.
You should not feel bad. You have AS, that is a great thing. I feel sorry for the normal people, who will live life never knowing the world we see. That's part of the reason they are social, most of them are not intelligent enough to think for themselves. They are like ants in many ways. But, if you have AS, your not an ant. You are much better than they are, you have proven that you can make it on your own. Most normals could never do that and the only reason they do is because there is someone to help them.
You may not have intense popularity or anything (I don't either). But I wake up everyday glad I am an aspie, I feel like I am a human, version 2.0. The rest of the world is slowly starting to figure out that us aspies are probably going to be needed for the human race to survive. As I am sure you know, aspies typically have something they are really, really good at. We will need this if we are to survive as a human race. Believe me, the future for aspies is bright, normal humans might be in a bit of trouble coping with that.