I too have horrendous problems focusing on a conversation while in a noisy environment, and even if I seem to cope well with it at the time, I always wind up paying for it later in increased accumulated stress, so that later something else I might normally have coped well with also, I just can't cope with.
So, knowing I get like that and assuming that there might be others like that too, my take on your day is that even though the doughnut shop encounter with your friends went well mostly, the bit of stress it caused when you had problems with the ambient noise levels stuck with you and later came out as less tolerance for your mother's voice on the phone. Even if that voice normally would cause you some sensory discomfort, it caused a bit more than usual because you already had some discomfort starting to accumulate "in the bank" so to speak, from the noise in the shop earlier.
I could be all wrong about that, but that's the kind of thing that happens to me and how it works with me. I can go through my day being in situations that are less than comfortable for me sensory-wise, but I deal, and I deal, and I deal with it, but it's like I'm accumulating more and more annoyance inside myself, or conversely I'm spending more and more of my available tolerance, that later on I have none left. So, the next thing that comes along that is a sensory issue or otherwise stressful for me, I've got "nothing left to give" and I can't handle it.
.