Self Studying over lectures
Although many physicists tend to like more the physics than the mathematical details, it is crucial for a physicist to master the required mathematical details. Understanding all the mathematical concepts  give you a high level of mathematical techniques which can be applied to various theories in physics. My advice would be to go to the courses, and also to study in great detail what you really like in your spare time, perhaps guided by a professor. Unfortunately, in physics, one must learn the mathematical language, and then the physics associated.