I think there is some anxiety from the stress of having to perform for women. Not just when you're courting them, but all the time in relationships with them. Whereas men don't need to be constantly reminded you love them, or constantly given verbal signs of affection. Just, you know, every once in a while is fine. Spontaneously instead of regularly and that's what I prefer. They're closer to where my 'normal' is, and I feel like I'm running on a treadmill trying to keep up when I'm dating women.
That said, I still find the ladies very attractive, and I still get crushes on them. It's strong enough to make it worth putting in the work to pursue them.