Party crashing is "socially un-acceptable", but consider we are the most social people ever. I give you credit for your actions.
In my experience, I have done that, but in much different scenarios. Like joining my fellow employees for lunch. Most people don't understand Asperger's and are, basically afraid to deal with Aspies. Most people actually end up liking me after I get through the uncomfortable meet and greet.
People sense my apprehension and mistake it for other NT style reactions. Like they think I'm ignorant or a a-hole.