I don't mind driving in country areas and areas I know well, but have problems driving in areas I don't know and in major cities. I have trouble trying to process where everyone is going and where I need to be, and start worrying I will upset someone by doing the wrong thing. If I am in heavy traffic I can't have any music on because the noise is too distracting, and would probably have trouble with other people in the car wanting to talk too.
I also had some issues with driving a manual car, the gear changes were a bit too much with having to concentrate on where I was driving at the same time - I drive an automatic now, and mostly drive places I know only. A GPS has also been really good for new places, as I can see where I am going in advance, and if I don't feel I can make a turn it will sort it out for me so I don't need to be as anxious about that.