I know that those of us with ASD like myself have been called lots of labels, such as "weirdo", "freak", "spaced out", "not all there", "has some sort of problem", "clueless", and a whole thesaurus of such pejoratives...but did you ever called called insane?
I can only recall being called "insane" on two occasions, once in early high school, and once in my 20s by a former house-mate, who also told me that "you need to be put in a special place where patient people can take care of you." - this was just an emotionally abusive a***ole though, as at the time I was gainfully employed in CS/IT and had a social and love life, and I could tell he was just pissed off that a "different" person got the same things others took more or less for granted.
That's one of the reasons I've historically try to avoid meltdowns when dealing with social frustrations, lest I get called "insane" for the reaction. 