Yes, I have had that happen from time to time but for the most part, people tend to gain their dislike towards me over a period of time because they learn I don't live up to their unrealistic expectations.
For me, I think it's because they don't know how to respond to my situation very well because they see I am a little off. Rather they either don't know how to approach me because they are afraid of saying something that might offend me or think they can have limited conversations with me.
For example, at my last place of worship the leader and his wife were sitting behind me having dinner for a special occasion where everyone dressed up in costume. They happened to be Superman and Lois Lane. They assumed that I knew everything about Superman so they asked me about the name of some reporter who worked with Lois and Clark. Sure enough, I told them that I had not seen the movie in a few years and that I was more interested in youtube blogs.
They said,"That's cool," which I understand is a polite way of saying, "Whatever!" and rolling your eyes so I turned around.