Deep Ranking/Best way to classify book covers?
I read some papers talked about it you can take a look on them maybe help you.

Deep Neural Network Learns to Judge Books by Their Covers

Classification of Book Genres By Cover and Title