With physics, i would try and drop it if you can. Its hard to do well in something you don't enjoy. If you can't, definitely consider private tutoring, but not colleges, and be honest with your tutor about all the issues you have. YOu get out what you put into tutoring sessions.
Good luck!