Keras OOM for data validation using GPU
There may be two causes to your problem:

In validation the network needs more memory.
There is another problem not directly related to this.

In this Keras issue you can find a discussion of a very similar problem. Basically, you can try:

Reducing the batch size.
If you are using Tensorboad, try disabling it or setting its batch_size parameter.