7. The method of claim 5 , wherein the external word embedding neural network language model generates the predicted current word using weight expansion of the hidden layer based on a concatenation of the external embedding matrix to the prediction word embedding matrix.
5. The method of claim 2 , wherein a hidden layer of the external word embedding neural network language model applies a hidden layer weight matrix to the input features.