Unfamiliar social situations can be more difficult for aspies to navigate. Try to give him, his words and actions, the benefit of the doubt. You say he is a nice guy so he likely doesn't mean anything hurtful to you. You are both trying to adjust to the other person so it might take a bit of time, but if you like each other why do you need to rush.