Not a lot of prospective employers have any knowledge or understanding of Aspergers or autism. Chances are their understanding if any at all is misguided, and we could place some of that blame now on what happened in Connecticut a few months back.
You could end up not getting a job based off this misconception that Aspergers is a "mental illness". Employers in general want to avoid "mental illness" in their workplace because the cost of having someone they believe to be "mentally ill" will cost their company more money than they would like to pay out. Of course, once stuck with someone who reveals such "mental illness" it becomes harder to let go of said employees in the event that they need to let that employee go. The onus could fall on the employer to make sure you get all the help you need and that itself costs money.
So really, it may be prejudiced based off saving money in the workplace and all companies want to do is save money where it matters most... productivity and attendance. Employers don't want one or the other, they want both. Both saves them money.