It took me forever to learn to drive and pass my test. The first few months were so awful, I was probably on the verge of giving up. Wasted time and money with two crap instructors. I then tried to save some money by having my dad teach me: worst decision ever. It led to nothing but bad stress and tension.
I finally struck lucky with a third instructor, who was a patient and kind man. Even then, it took me a full year to pass my test (on the 3rd try). There were a couple of factors against me, but I suspect even if I had learnt to drive at 17 in perfect health, I still would have taken longer than the average learner. The coordination required to drive a manual car and watch the road simultaneously took a very long time to master. Roundabouts and "meets" (where two cars can't pass through the same gap, so one has to wait while the other one goes) were the stuff of nightmares.
I was exhausted and famished after every lesson. It really did take it out of me. Even the social part of sharing a car with somebody for an hour or two I found quite difficult to deal with sometimes.
The driving test I found extremely stressful. Not sure how I got through it three times, tbh.
For about a year after passing the test, I was a pretty timid and nervous driver. Had a couple of accidents, one serious enough to write off my first car. After that first year, things gradually improved. I stopped being terrified of roundabouts and changing lanes. I became so much better at coordination and using the clutch. Four years on, I find driving pretty simple now. Even with my short attention span, distraction isn't an issue. I concentrate fully when I need to and half concentrate when I don't. I also try to see what's up ahead of me, so I can prepare in advance. I don't think I'm any worse a driver than average. And better than some, given some of the antics you see on the roads.