How to get feature importance from a keras deep learning model?
There is plenty of methods to calculate feature importance. I recommend trying two of them LIME and SHAP. 

I don't want to copy-paste material and tutorial provided by the author so please refer to these two repositories.