1. An annotating system for aiding a user in performing bulk mapping of queries to tasks to obtain training data for training a search component, the annotating system comprising: a query log containing queries which have previously been submitted to a search engine; a task list containing a plurality of possible tasks; a machine learning component which suggests best guess query-to-task mappings as a function of the training data; and a graphical user interface generating component configured to display at least some of the plurality of query entries in the query log and at least some of the plurality of tasks in the task list in a manner which associates the suggested best guess query-to-task mappings.