Physics isn't really that hard. As many say, all you need to do is put in the effort. And you really don't have to remember formulas, they're always given to you in exams, all you need to know is how to manipulate and use them.
My suggestion to you for that extra unit is pick English Extension...