Too much presence of others in the house would drive me nuts.
And living through the toddler years drives every parent nuts.
In other words, everything you are feeling is perfectly normal.
But you do need to find a way to help yourself. Dinner with some other moms, stuff like that might be the ticket. Find a way to schedule some "me" time into your days.
_________________
Mom to an amazing young adult AS son, plus an also amazing non-AS daughter. Most likely part of the "Broader Autism Phenotype" (some traits).