Different X, Y input shapes
try to add more conv layers, and also play a bit with hyperparameters to improve accuracy.
Currently, the learning rate is being used as default, try to tweak it from 0.01 to 0.0001.