Can I learn astrophysics and astronomy with my basic math?
Generally, astrophysics (and astronomy) is math-heavy. That should not discourage you, but rather act as a way of learning math: it is often easier to learn topics that you have a use for and are part of some personal project than just getting lectured about them. 

Astrophysics is based on math because it is based on many forms of physics - mechanics, thermodynamics, nuclear physics, relativity theory and so on - plus chemistry. Mathematics is a common language that binds these fields together and allows you to combine them to build models to understand what is going on. Some parts just use some basic math, but in general calculus really is needed.

Mathematics in the more common "calculations with numbers" form also matters because it all starts with measuring things - where things are, how much they change, brightness and so on - and then we build and test our models and understanding from this. That also means that statistics is important for handling measurement noise and finding patterns in data.

One cannot really do astronomy and astrophysics without math. It would be just looking at things and making up explanations without actually checking if and how they hold true.