I take a seam ripper to the stitches holding on the label, and it removes it better than cutting or ripping out the labels. Fortunately now you can find clothes that are completely tagless, so I have a lot of those items. The underwear I prefer is the tagless variety because I found those labels to be even more annoying.
_________________
"I do not feel obliged to believe that the same God who has endowed us with sense, reason,
and intellect has intended us to forgo their use."
- Galileo Galilei