5. A system comprising: a processor; and a computer-readable storage medium having instructions stored which, when executed by the processor, result in the processor performing a method comprising: during a first execution of the natural language understanding application: receiving a sequence of words to yield a received sequence of words; assigning a sequence of tags to the received sequence of words by using the statistical model, to yield annotated words; and when sufficient annotated words become available, updating the statistical model; developing a replacement statistical model for the natural language understanding application using the annotated words by: developing a first part of the replacement model without the human knowledge; developing a second part of the replacement model from both the human knowledge and the annotated words; and when the received and subsequently annotated data is sufficient, weighting a contribution from the first part more to the assigning than when the received and subsequently annotated data is insufficient and during a second execution of the natural language understanding application, receiving a second sequence of words and assigning a second sequence of tags to the second sequence of words by using the replacement statistical model.
5. A system comprising: a processor; and a computer-readable storage medium having instructions stored which, when executed by the processor, result in the processor performing a method comprising: during a first execution of the natural language understanding application: receiving a sequence of words to yield a received sequence of words; assigning a sequence of tags to the received sequence of words by using the statistical model, to yield annotated words; and when sufficient annotated words become available, updating the statistical model; developing a replacement statistical model for the natural language understanding application using the annotated words by: developing a first part of the replacement model without the human knowledge; developing a second part of the replacement model from both the human knowledge and the annotated words; and when the received and subsequently annotated data is sufficient, weighting a contribution from the first part more to the assigning than when the received and subsequently annotated data is insufficient and during a second execution of the natural language understanding application, receiving a second sequence of words and assigning a second sequence of tags to the second sequence of words by using the replacement statistical model. 8. The system of claim 5 , wherein the first part comprises a projection based Markov Model configured to provide a probability of a tag being assigned to a word in the received sequence of words.