Yes, I find talking to a passenger while I am driving to be distracting. I am okay with singing or humming along to the radio, as it apparently requires a slightly different brain track. I also can handle talking to myself to help me think things throug, while driving, but talking that requires interaction with others is more complex. The other side of the conversation comes from someone else's brain, so it takes more processes resources to focus on, absorb, and respond to such conversations. This takes away resources being used to safely navigate the road, and deal with driving hazards. Fortunately, I rarely have passengers.
_________________
If a man does not keep pace with his companions, perhaps it is because he hears a different drummer.
Let him step to the music which he hears, however measured, or far away.--Henry David Thoreau