Tensorflow MirroredStrategy() looks like it may only be working on one GPU?
I'm seeing the same thing, here I enabled just the first 2 GPU's. 
If I force it to use just 1 GPU the memory utilization drops but the amount of time per epoch is unchanged.