How to structure time series for binary classification in Keras?
you want to treat the date as a cyclical feature to capture patterns in the time stamp.

http://blog.davidkaleko.com/feature-engineering-cyclical-features.html

Keras + SK learn work nicely together. here's an example in my GitHub to extract patterns from the time stamp (just adjust to your needs and replace my Decision Tree with Keras code).

https://github.com/FrancoSwiss/Fraud_Detection/blob/master/Kaggle%20Fraud%20(1).ipynb]1