It only helps a bit with mechanics, so it's not worth doing a whole HSC subject just for that. Plenty of people get by fine doing the mechanics topics without having taken physics, since the concept of forces and whatnot is not that hard to learn, especially for a 4unit student.