I find just the opposite. At 45, I have something I never did untile recently - a modicum of self-confidence - and that (I've been told) translates into a presence that most people find difficult to not notice, even though don't try to deliberately draw attention. Wherever I go, I always have a "not from around here" look. People seem to at as minimum want to investigate, and usually are at least somewhat intrigued. Being 175cm (5-9) with long red hair will attract attention most anywhere, and being size 18 doesn't seem to put too many people off - the intrigue occurs at a different level, apparently. I look and feel best wearing red, and will dress in red more than half the time. I don't consider myself particularly attractive, but a considerable number of people treat me at though I am.
In some places, very prominently in Asia and somewhat less so in eastern Europe, I appear so different from the general population that it is uncommon for me to walk down the street for more than a few minutes, either in a small village or a large city, without someone I don't know stopping me for some purpose or other.
I have always been noticeably different, sometimes more subtly, other times unmistakably, but over the years I have gone from being embarrassed and ashamed to understanding my differences and making the most of them - and even enjoying it.