Math graduate, not enough physics coursework to apply straight to physics MS
If you are studying in the United States, you should take the core physics undergraduate courses from a reputable university.  Then you should apply directly to PhD programs.