KL-divergence returns infinity
The infinity is due to divide by zero. 
Just replace any zero value with a very small value.
This question is very common , if you search for it you will find many questions similar to it . 
Remember that kl is not a metric