How reproducible should CNN models be?
Getting slightly different results is natural and should not be a problem. How to minimize the instabilities due to several contributing factors is discussed at length in the linked post below, for Keras using different backends including TensorFlow: 

https://machinelearningmastery.com/reproducible-results-neural-networks-keras/