I'm aromantic myself, though I questioned if I was a late bloomer for different reasons. In my opinion, if you feel like you're aromantic and feel comfortable with the label, so ahead and use it. If you later do experience romantic attraction, maybe look into it a little more. You could be sometimes or part aromantic (gray-aromantic, aroflux, etc.). Even if you do chose to identify as aromantic now, but find out you're not later, it's fine. People change. Just identify like you want.
I'm fairly sure there are even labels for people who specifically feel like their autism/aspergers/neurodivergence cause their being aromantic. I don't know what they are off the top of my head, though.