1. A method of storing speech information for use in retraining a speech model, the method comprising: receiving a speech signal; identifying at least one feature value for each of a set of frames of a speech signal; decoding the speech signal based on the speech model to identify a sequence of alignment units; aligning a state of an alignment unit from the sequence of alignment units with a frame in the set of frames of the speech signal; and before receiving enough frames of the speech signal to begin retraining, adding at least one feature value that is identified for a frame to a feature value sum that is associated with the state that is aligned with the frame.