Doing PhD in math/physics after obtaining a bachelor degree in an unrelated field
You should contact potential advisors who work in the areas in which you are interested.  Introduce yourself, explain any work you've done, and ask if they have specific feedback for moving on in your career.  You should contact several people.  If you live near a university, arranging a time to meet with some current faculty members is also a good way to go about this.