sentence1: the decoder and encoder word embeddings are of size 500 , the encoder uses a bidirectional lstm layer with 1k units to encode the source side .
sentence2: the language model has an embedding size of 250 and two lstm layers with a hidden size of 1000 .