I lost my virginity at 22, and I had never thought/cared about it previously. I used to masturbate in some periods, and I feel it's good in healthy amounts (and it's good to know your body), but I wasn't much sex driven. Anyway, It was nice, not because the sex itself but for the intimacy bond created between me and this guy, it was intense and broad my horizon on how I could connect with people, which is also quite frustrating because I can't have this with more people and I'm far from this guy. On a negative side, I became a bit obsessed with STDs for a while, even if I had safe sex, got tested, got the guy tested and everything.
Know your time and your body, and don't pressure yourself over societal pressure. Even this idea that everyone is having sex is a biased image, and even if it was real, that shouldn't mean anything for you.