It has very little to do with being an aspie, that much I can tell you.
Once I was in a relationship with a man who was otherwise pretty good to me, but anytime we had a disagreement he would insist on seeing me cry. I don't cry easily and I do not enjoy crying, but he would never let up or back down until he'd hurt me badly (and then he'd be very sorry for having done so, but the next time he still could not control himself). I think he went on to overcome that part of himself but I'm glad I didn't wait around for him to mature.
You sound miserable. It can be hard to tell which partner is most responsible for a negative dynamic in a relationship but it doesn't matter much. Why are you sticking around?
_________________
The machine does not isolate man from the great problems of nature but plunges him more deeply into them. -Antoine de Saint Exupéry