I've always been fine with it. In fact on my car I have a loud exhaust, a Thrush Turbo muffler, and even rode it mufflerless for a couple days. I'd like to put a resonator on it to quiet it down somewhat, but I prefer a louder less restrictive muffler so the car isn't dead silent. I still like it quiet enough to have a conversation in the car and not have me get pulled over by the police. When I was younger, I used to think every motorcycle was so loud, but now it's just like "oh, that's normal" and I get more surprised by a motorcycle with a quiet exhaust "wtf, he's got stock pipes on there still?"
My personal lawnmower, though, is a reel mower, no noise, and it allows me to mow my lawn at like midnight if I choose to. It's pretty sweet, I highly recommend reel mowers, no gas, no oil, no varnished carburetors, etc, it's awesome.
Then again, one of my "special interests" is cars and internal combustion engines in general, so loudness doesn't really affect me at all.