My son is 5 too, and he had the same problem, He didn't seem to understand that my finger was pointing to something, he would stare at my hand, or look in random directions, so I taught him left, right, up, down, in front, in back, etc. so now when we want him to look at something we'll tell him look to your left, or look behind you, while pointing to whatever it is that we want him to look at. that seems to have helped