1. A method for collaborative note taking based on a speech of a speaker and providing a summary to a user in an audience of the speaker, the method comprising: receiving a first set of information from the speech; performing speech recognition on the first set of information and determining selected portions of the speech; determining portions of context information corresponding to a domain information from a presentation information source temporally associated with the selected portions of the speech; determining at least one language model based on the selected portions of the speech and the temporally associated portions of context information from the presentation information source, wherein the at least one language model is dynamically determined; applying the language model to the first set of information to extract salient tokens from the first set of information; verifying relevance of the salient tokens based on the presentation information source to obtain verified tokens; generating the summary including the extracted salient tokens, wherein generating the summary includes assembling the verified tokens; displaying the summary to the user; and receiving collaborative user feedback information relating to the summary and adjusting the language model according to the collaborative user feedback, wherein the method is implemented by a computer.