If your boss knows you're autistic, then you can tell the people that want to talk to you that you like them....but that sometimes it is stressful for you to interact with others because of your autism.
Say it in a conciliatory manner, and thank them for "listening."