Depends on your settings. You can hide groups from your friends. So I think you might have to quickly hide a group once you've joined. Here is how you hide a group ( you'l have to google it , not allowed to post URL's )
I considered hiding the autism groups I've joined but decided not too ( Had no trouble so far )