Is there a way of pre-determining whether a CNN model will perform better than another?
I would like you to try with following changes in the model. 


Introduce batch normalization layer in the model. 
Try with the batch size of 32 - 64
Use different architecture, Like VGG, Resnet, etc..


There is no full proof answer to this question but you can get best by trying some know strategies.