I do not believe it's a subject that is considered "hard" but rather your study technique for that subject and how you approach your weaknesses
If you break down the physics syllabus (and the exams) you can divide it into the following: Scientific skill, understanding concepts, rote memorising...