I understand what you mean. Within the last year or two, I've come to realize that I identify as an ftm, but I've been bothered by my breasts since they started growing. I'm a D or DD, and they are extremely uncomfortable. They make it difficult to breath and exacerbate my acid reflux. I'm also very sensitive to heat, so they get very sweaty when I get hot.
I've tried a lot of different types of bras and recently got my first binder. I've always worn a bra at night too, even though my mom and sister find it odd. It's just really uncomfortable without some sort of structure--like a lot of things in my life!
And @ Caesaran, just a quick point: for anyone not planning to have children, breasts aren't really purposeful. However, I do agree 100% about the breastfeeding, and I'm extremely thankful that my mom did too