How can I study the math behind cryptography?
Speaking from my own experience, Nigel Smart's book Cryptography: An introduction is a good place to start. I would say that you can read and understand it without any prior knowledge of cryptography at all. It is also free.