I think it is great that you have a sense of what you want, even if you are not entirely sure what you want to do about it. Based on what you have expressed, I would say that you should either, nip it in the bud, and end it, at this time, or, if you like him and think that he would make a good friend, perhaps get together with him, again and make a final decision, based on how you see things at that time. If you find yourself sure that you wish for nothing more than friendship, let him know, and see how that plays out. If he is open to that, then great. You have a new friend. If not, do your best to end it, and move forward, immediately following. Not sure if my suggestion fits your circumstances, as well as that of someone else, here, who perhaps knows you. I wish you the best! : )