sentence1: moreover , the embeddings are expected to be normalized -we can use either l 2 -normalization or batch-normalization for this purpose .
sentence2: therefore , we apply batch-normalization to the output activations of the layer to alleviate this problem .