How to reduce the GPU consumption size while using Elmo Model?
I understand that you are doing only inference, so you shouldn't need your model to be trainable, and therefore you can set the parameter trainable to False when invoking hub.Module.