My dad is very similar to me. I think that he has Asperger's too, but maybe to a lesser degree. We get along okay now that I don't live in their house, but when I was younger he was very strict, verbally and occasionally physically abusive, not at all affectionate or loving, and completely uncompromising. Everything had to be exactly his way all the time, which meant a very uncomfortable existence for me. For instance he is always hot and I am always cold, and he would demand the air conditioner on in the car at all times, or else the windows rolled down (even on the freeway), and as my "spot" in the car was behind the driver's side, this was very bad for me. I would often be crying because I could not handle the air on me. But he did not care at all.
The only way we get along is through our shared humor. We have the same sense of humor that not many others can really understand.
So things are neutral now, but when I was a child it was not pleasant at all.