I'm on the same page as the OP in that my anxiety is far more debilitating than any of my ASD tendencies. I have generalized anxiety disorder, which means that I am constantly on edge and worrying about things every single day, so it's very hard for me to relax and take things with ease. I have physical symptoms as well: my back and shoulders ache all the time. If I'm not keeping it in check, I'll deal with it impulsively (i.e. get really drunk) or I'll have a meltdown where I'll just have to spill everything out.
In contrast to AS behaviors, which I feel have to be dealt with as difficult situations arise, like navigating your way around social situations, anxiety is constantly present and has to be dealt with at every single waking moment.
_________________
Given a “tentative” diagnosis as a child as I needed services at school for what was later correctly discovered to be a major anxiety disorder.
This misdiagnosis caused me significant stress, which lessened upon finding out the truth about myself from my current and past long-term therapists - that I am an anxious and highly sensitive person but do not have an autism spectrum disorder.
My diagnoses - social anxiety disorder and obsessive-compulsive disorder.
I’m no longer involved with the ASD world.