You could watch a documentary on advanced physics and get a lot out of it, even if you never took college physics, or even high school physics for that matter.
Many times when you start to understand a topic, you kind of arc across it. You see the three main things, or the four main things, or the two main things, and you start to put it together. You become an active learner. And even if you later turn out to be mistaken, at least you have a theory you can start to ask questions about.
I'm posting this because so many times in high school and college, I was dogged by the belief that there was only one right way to do it and that was the slow and thorough way. Not necessarily the case! We can learn in a variety of styles. We can both play to strength and experiment with adding new strengths.
In addition, when you jump ahead, you can start getting benefit out of the very next lecture. You don't need to wait a week to get "caught up." 20 minutes will do--sometimes less!
Have fun, experiment, learn a lot, learn in different ways (or with one primary style, both are perfectly valid).