I actually get the exact opposite - people say i'm a very good listener, and often come to me for advice/to talk about their feelings/problems etc. I always make sure that i come off as understanding to the people i talk to, it's important for me to make people feel like i'm "there". Things you can do to express this: Ask questions (for example a question that summarizes something they told you, which leaves them noticing that you've been all ears to their words, and are interested in knowing more) eye contact (even if uncomfortable sometimes this does make people feel like you are more present in the conversation), Occasionally nod and express ("wow", "really?", "I can imagine that's difficult..").
My grandmother have difficulties appearing as a good listener.. I used to get really annoyed at this as a kid, and would many times actually end up taking it personally, sometimes even tearing up, or getting angry at her for not seeming present whenever i told her something difficult to me or opened up. Makes me wonder if she has Aspergers to xP Though she doesn't really have any other Aspie traits besides that so i doubt it.