1. A method for determining a source meaning for a web page document, the method performed by a document server implemented as a network of computer processors or as a single computer system, the document server executing a document engine, the method comprising: receiving a web page document; identifying, based on formatting information of the web page document, a collection of different regions contained within the webpage document, that would be displayed to a user visiting said web page document, wherein the regions contained within the webpage document contain content between opening and closing HTML or XML tags; determining concepts expressed in each of the previously identified different regions in the collection, wherein determining the concepts expressed in each of the different regions comprises identifying words contained within each of the different regions and aligning the words with concepts; determining scores for the concepts expressed in each of the different regions, wherein the score for a concept expressed in at least one of the different regions is based on a size of the at least one of the different regions; creating a ranked global list of concepts based at least in part on said scores for said concepts expressed in each of said different regions; removing unrelated concepts from said global list of concepts; determining the source meaning for the web page document, wherein determining the source meaning includes excluding the unrelated concepts from the determination of the source meaning and wherein the source meaning is a vector of said determined concepts expressed in the web page document; and making the previously determined source meaning available.
1. A method for determining a source meaning for a web page document, the method performed by a document server implemented as a network of computer processors or as a single computer system, the document server executing a document engine, the method comprising: receiving a web page document; identifying, based on formatting information of the web page document, a collection of different regions contained within the webpage document, that would be displayed to a user visiting said web page document, wherein the regions contained within the webpage document contain content between opening and closing HTML or XML tags; determining concepts expressed in each of the previously identified different regions in the collection, wherein determining the concepts expressed in each of the different regions comprises identifying words contained within each of the different regions and aligning the words with concepts; determining scores for the concepts expressed in each of the different regions, wherein the score for a concept expressed in at least one of the different regions is based on a size of the at least one of the different regions; creating a ranked global list of concepts based at least in part on said scores for said concepts expressed in each of said different regions; removing unrelated concepts from said global list of concepts; determining the source meaning for the web page document, wherein determining the source meaning includes excluding the unrelated concepts from the determination of the source meaning and wherein the source meaning is a vector of said determined concepts expressed in the web page document; and making the previously determined source meaning available. 2. The method of claim 1 , wherein identifying the collection of different regions in the document comprises identifying frames in the web page document.