Process melspectrograms with convolutional neural network
Leave the resolution untouched, and introduce more convolutional
  layers.


This should be the next step. Two primary reasons for it :


This should reduce number of trainable parameters 
Model can learn more abstract features