I'm wondering if it is possible for an Aspie to be accused of being manipulative - without them actually having intended to be manipulative. I can see two general categories in which this could be the case, but I've only really been subject to the first one:
1) We tell people about our disability and how it affects our social intuition, judgement, speech etc - typically in response to someone getting angry at us for the effects of our behaviour - and get an equally angry retort that we're just trying to manipulate them for pity, and we should deal with it, try harder, etc, but don't expect them to bend to us based on compassion;
2) Somebody who is very "naive" about Asperger Syndrome, somebody who has a very hard time believing that people don't have these natural intuitive responses to social situations and would assume bad intent first, might accuse us of tricking them into gaining an advantage or the upper hand by appealing to a false sense of reason. They may see it as a "power trip" for us to psychologically abuse the other person/party by pretending that there's a problem and asking for concessions to gain advantage. Such as asking someone clarifying questions for "common sense" stuff, could be seen as psychologically attacking someone to make them wonder that they have a communications problem with everyone and intentionally hurt their self confidence.
Can't think of a detailed personal example offhand, but one that comes close was a situation with some room-mates (flatmates) in my early 20s (pre-diagnosis) where I was accused of manipulating them through my "psychological warfare tactics" and I had to leave due to threats. Also I had another roommate later in life who was definitely a sociopath and she would use pre-emptive strikes (deflecting tactics) where she would accuse me as being the manipulator, to plant seeds of doubt so that I couldn't accuse her of being manipulative.
Of course, we can't really be that proficient at #2, since we inherently lack ToM.
If somebody would accuse me of being manipulative of the 2nd category, heck I'd just turn around and tell them "Actually, I'm not the manipulative type at all; if anything I'd be more on the receiving side of manipulation. And incidentally, this tells you that I'm not the arrogant type either." - of course, I wouldn't use that on a bully who employs deflecting tactics like those described above.