People are egotistical by nature. Since everyone literally sees the existence from inside of their body being literally in the center of existence, no wonder everyone thinks only of themselves as VIP or more like MVP(most valuable person). If we could've just easily precieved world from any perspective it would be very freeing, like looking at your city from high place or looking at the stars combined and multiplied by 1000.
As for your solipsism perspective, yeah, I feel that fear sometimes. Donald Hoffman has interesting talks about this whole subject. Sometimes I fear that this is a complicated hallucination of a world, weird dream. You know, because dreams appear real for some time no matter how weird they are, from inside the dream everything seems proper and reasonable. And people believed in the dumbest s**t before, so our limited perception might as well be something like that.
I think that this feeling appears because of lack of real connection and understanding of the world and people around you. Like I can't really see other person's mind, can't feel what they feel so it may as well be an illusion. Sometimes I even don't trust my own thoughts and feelings because if you are being honest with yourself you understand that you are more like an observer inside of complex biological robot and your thoughts aren't actually yours. They come and go and you stay behind and above everything. Saccades make the trust in your sensory perception very futile (see "Blindsight" by Peter Watts for extra creeps). Memory can't be relied upon too much too, because we make up ton of stuff on the go.
Even the rational mind itself sometimes feels like the parasyte upon a parasyte (personality/ego). Like my body just wants to live and function like any animal body, but here am I, forcing it to do various things, preventing it from being free, and on top of that there is a mind which appears to play it's own games ny its own rules (i.e. antropocentric, black and white, determenistic thinking, with scarse input info and tremendous speculative output of bogus models and expectations). I read Kant's critique for a while now and the main theme is "We can't trust our own perception of reality, reality appears to us in a certain way, but we can't really know what reality is, because our perceptions and mind act like a filter" and we can't percieve world in any other way. I don't let this realisation sink in too deep because I feel like it may be dangerous for the psyche. Like why do we even percieve the world visually in a certain way? Is it because of shape of our eyes? Or is it because of laws of light traveling? Can we like see in 4D? And isn't our vision is really a fake 3D, like 3D glasses of sorts? And if time is just an illusion, how would world appear to us? (Certainly not like all things merged together or mixed in some way becuase this concept is born out of our linear time perception itself).