His response definitely suggests he was offended, but I'm not exactly sure by what. The only thing I can think of is he took it as a racist comment. Otherwise, there is nothing offensive about what you said. I can barely see how it was racist either, if that is what he thought.