I can understand where you're coming from, Cnidocyte. I enjoy socialising but I enjoy times on my own too. Some NTs can't accept that I like being on my own sometimes, they think that any moment that I spend on my own must be hard for me, and they insist on keeping me company even when I make it plain that I don't want it. I strongly dislike these in-your-face bigots.
Having said that, there are also plenty of NTs who will at first assume that you want as much company as they do, but who, when they start to know you better, will accept your desire for solitude. Have you never met anyone like that? If not, maybe you pick the wrong people to associate with.
Dr. Tony Attwood understands the solitude vs. socialising thing in terms of emotional restorative. He explains that, for nonautistic people, the best emotional restorative is socialising, whereas, for people on the autism spectrum, the best emotional restorative is solitude. This makes sense to me.