44. A method of optimizing searching as in claim 43 wherein the business entities correspond to corporations, agencies, or organizations.
43. A method of optimizing searching in a data processing system comprising the steps of: obtaining website content of business entities that are included in a control group, where the control group defines a classification system that is based on a standard industry classification system (SIC) predefined taxonomy of SIC business activities having verified information about the business entities, the classification system being used to classify and store the website content of the business entities; searching for unclassified business entities using at least a portion of the website content of business entities in the control group; classifying the unclassified business entities based on the portion of website content of business entities in the control group; identifying commonly occurring keywords in website content of business entities that are similarly classified in the classification system of the control group; allowing the control group to grow if a substantial amount of commonly occurring keywords have been identified; and creating a new business entities category to update the classification system of the control group allowing the control group to grow by: identifying keyword matches in the stored website content by identifying any commonly occurring keywords or phrases in the website content; and processing the matches identified by determining whether any of the keywords or phrases in the identified matches contain one or more keywords associated with any of the SIC business activities in the SIC predefined taxonomy; and using the control group to optimize full text index searching of the website content by organizing search results according to categories in the classification system of the control group.