I hate talking on the phone. Especially when people call just to chitchat or whatever. I usually start going with one-word answers and keep wondering what the actual purpose of the call is. At least with the chit-chat that happens in person, there's some kind of actual situation you're both in, so there's something to go on for making conversation. So, yeah, i avoid talking on the phone. I still don't like talking on the phone at work, but at least then there's a clear question that i need to answer, there's a certain structure about that. And, with e-mails, you're usually talking to someone about a common interest or something... it's not just the "hey, what's up. let's talk now!" that people expect over the phone. That's all i can make of my hatred of phone-talking, anyway.
With really close family it can be better, though. Because then you know what to say to that person, and you're used to the things they say... but i still find it a tiny bit awkward, even then.