Why is my CNN not training
A rule of thumb, as you go deeper, number of filters increase and the size of filter remains same or increases. You don't follow both of them. This will help your network learn.
Then, consider increasing the number of filters in proper fashion if still your network is not learning.