How can I find if it is an overfitting problem?
These are some ways by which you can improve your model's accuracy and reduce overfitting.

Split your dataset into training, validation, and testing.
Add dropout.