Groups of people talking are my biggest annoyance, and mix it in with the sounds of a city, and you have utter hell for me (in addition to yelling and stuff).
I find I'm attracted to loud impulses, like lightning, gunshots, explosions (sadly, I've only heard one proper explosion, albeit it was low order), and etcetera.