I think it depends. I remember the sight the sounds, the smells, texture of things I was wearing, tastes of food, etc. for many years.
I remember the exciting smell of my first day at my preschool that had a hot lunch served in a cafeteria every day. I remember the feeling of wet blood on my hands after I gashed my forehead on a desk as a 3 year old. I remember the feel and the close-up appearance of texture of the cushions on our old living room couch that I would pull myself up on when I was still unsteady on my feet. Sometimes, if I am listening to music or TV while drawing, I'll even look at that drawing and remember specific bits of the song or the episode when I look at certain pencil strokes. I've also been known to memorize numbers both by sound and appearance, then when I recall them I can get a sense of how reliable that particular memory is based on whether the sounds "one two five seven" match up with the images "1, 2, 5, 7" If they disagree, I know that I need to go back to check it.
My mind is definitely multi-modal.