I went through a similar situation when my marriage ended, at the time I didn't know about AS, I just knew I was different.
My ex wife was very social, and when we were out in any type of social envirnoment she was very quick to socialise with other people.
In hindsight, all I really wanted to see, through actions not words, was that she would choose me. I felt that she was just staying with me because we were married with kids. This thought festered in my mind and without seeing anything to disregard it, I became distant and unloving.
I don't know if this is how your husband feels, but it won't hurt to let him see, if/when a genuine opportunity arises and in an emotional honest way, that seperate from any family or life commitments, you would simply choose him.