All I can say is that I know what it feels like to feel like other people are gossiping bout you and view you as some kind of weirdo.
You have a right to go to the mall and do your own thing as long as you're not bothering anyone else.
People will do and think whatever they do, but that's their business. Try not to dwell too much on it and just life your life the best you can.