You don't really have to worry. They don't expect you to have previous knowledge. But if you want, just flick through a textbook and watch a few videos on YouTube to somewhat have an understanding of what Physics is all about. Personally, I never paid attention in junior science and I chose two sciences for Year 11. And I'm currently doing fine in both.