It is verI would say one of the problems is that children are expected to never leave a room without permission, etc... As a child, I was often forced to remain in a noisy, bright room for many hours in a day. I would often end up in a rage due to sensory overloads that I wasn't allowed to remove myself from. Had I been allowed to remove myself from situations, it wouldn't have been nearly as bad as it was...
Now, being a college student, the professors don't care if you get up and leave in the middle of class (they're not responsible for the well-being of students, only teaching the curriculum), and because of that, if I experience sensory overload, I can just leave the room for 5 minutes (possibly even going to the bathroom or something) and returning when I've recollected myself. The same applies to most situations I am in. Also, because the environment of a college class is much less raucous than that of even a high school class, I don't have to deal with sensory overload nearly as much.
Now if only there was a school that taught elementary school level knowledge to elementary school kids in a college classroom setting... I would have fared so much better...