It would suck.
First, it just won't function. There's too many reasons to write, but we just need NTs!
Second, it would be so extremely boring!! At least for me.
I wouldn't like to live in a town like that. I like to know lots different people, i like lots of NTs (still i also dislike many of them), i don't like lots of Aspies/HFAs i met (but still there are some i like - that's why i am on this site). I don't think it matters if someone is an aspie or nt, they're just people. And aspie can be intolerant, while nt can accept you as you are. It depends WHO you meet, not if he has disorder or order XD And i think lots of aspies won't handle some duties in town.