text:
A relevancy ranking and clustering method and system that determines the relevance of a document relative to a user's query using a similarity comparison process. Input queries are parsed into one or more query predicate structures using an ontological parser. The ontological parser parses a set of known documents to generate one or more document predicate structures. A comparison of each query predicate structure with each document predicate structure is performed to determine a matching degree, represented by a real number. A multilevel modifier strategy is implemented to assign different relevance values to the different parts of each predicate structure match to calculate the predicate structure's matching degree. The relevance of a document to a user's query is determined by calculating a similarity coefficient, based on the structures of each pair of query predicates and document predicates. Documents are autonomously clustered using a self-organizing neural network that provides a coordinate system that makes judgments in a non-subjective fashion.
1. One or more computer readable media storing computer executable instructions to perform a method for vectorizing a set of document predicate structures, the method comprising:
identifying at least one predicate and argument in said set of document predicate structures by a predicate key that is an integer representation;
estimating conceptual nearness of two of said document predicate structures in said set of document predicate structures by subtracting corresponding ones of said predicate keys; and
outputting at least one document based upon the estimated conceptual nearness.
2. The computer readable media of
3. The computer readable media of
4. The computer readable media of
5. The computer readable media of
6. The computer readable media of
7. The computer readable media of
8. One or more computer readable media storing computer executable instructions to perform a method for vectorizing a set of document predicate structures, the method comprising:
identifying at least one predicate in said set of document predicate structures by a predicate key that is an integer representation;
estimating conceptual nearness of two of said document predicate structures in said set of document predicate structures by subtracting corresponding ones of said predicate keys; and
outputting at least one document based upon the estimated conceptual nearness.
9. The computer readable media of
10. The computer readable media of
11. The computer readable media of
12. The computer readable media of
13. The computer readable media of
14. One or more computer readable media storing computer executable instructions to perform a method for constructing multi-dimensional vector representations for each document of a set of documents, the method comprising:
determining each predicate structure of one or more predicate structures M in each document of the set of documents, said M predicate structures including a predicate and at least one argument;
identifying the predicate and the at least one argument in each of said M predicate structures by a predicate key that is an integer representation;
determining a fixed number of arguments q for vector construction;
constructing an N-dimensional vector representation of each document based upon the predicate and q arguments; and
outputting at least one document of the set of documents based upon the constructed N-dimensional vector representation of the at least one document,
wherein any predicate structure of said M predicate structures that includes less than q arguments fills unfilled argument positions with a numerical zero.
15. The computer readable media of
16. The computer readable media of
17. The computer readable media of
18. The computer readable media of
19. The computer readable media of
The relevancy ranking and clustering method and system for document indexing and retrieval of the present invention is intended to provide mechanisms for an information retrieval system to rank documents based on relevance to a query and in accordance with user feedback. A user can make queries in the form of natural language, keywords or predicates. Queries are converted into ontology-based predicate structures and compared against documents, which have been previously parsed for their predicates, to obtain the best possible matching documents, which are then presented to the user. The present method and system is designed to automate judgments about which documents are the best possible matches to a query within a given index. The system is further designed to allow users to provide feedback in order to fine-tune the automated judgment procedure.
As the volume of information available on the Internet increases, the need for methods to search, filter, and manage such information is increasing. Text categorization has become an important component in many information search and retrieval systems. Conventional search and retrieval systems commonly classified information into several predefined categories. For example, Yahoo!'s topic hierarchy provides a complex tree of directories to help users locate information on the Internet. In many search engine companies, trained text editors manually categorize information. Such manual classification of information is not only a very time-consuming and costly process, but is also plagued by inconsistencies and oversight problems. To overcome such problems, automated methods for categorizing text are becoming more common.
U.S. Pat. No. 5,418,948 to Turtle discloses an information retrieval system, which stems all input words (as well as removing stopwords), and matches the resulting queries against a table of known phrases in order to convert phrasal inputs into a standardized format. A Bayesian inference network ranks the results, where each document is associated with a set of probabilities for all of the words within the document. These probabilities are calculated with respect to a hierarchy of document-organization categories. Retrieval may be accomplished through two techniques, which can result in different rankings for the same collection of documents.
The first technique used by Turtle is document-based scanning, where each document is evaluated according to the probabilities of each of its attributes in order to determine the probability that it answers the query. After a sufficient number of documents are retrieved, while scanning continues through the collection, documents are only evaluated through a subset of their attributes. This means that after some critical number of documents is reached, documents which are unlikely to rank higher than the lowest-ranking document in the set are not added to the list of results.
The second technique involves so-called concept-based scanning, where all documents containing a query concept (including its synonyms as defined in a thesaurus) are evaluated according to the probability of the query attribute within the document. This means that only a few attributes are examined for each document, but they are the same for all documents. As with document-based scanning, documents are no longer added to the result set when a critical number is reached and the probability of a new document outranking any documents currently within the set is extremely low. The stopping criteria are not identical, and the interpretation of the same attribute probabilities may lead to different rankings for the same documents, even when matched by the same query. In both cases, scoring is calculated by averaging the probabilities for all of the attributes in the query (adding the individual probabilities, then dividing by the number of concepts).
Turtle's system is deficient in several respects. First, by scoring documents according to the relative occurrences of terms within the index, highly relevant documents with low-probability concepts may be missed. Second, periodic recalculation of attribute probabilities is a necessary performance penalty, if new documents will change the probability distribution of the attribute set. Third, the thesaurus-based approach treats synonyms as equally valuable terms in a query. This may expand the result set such that the stopping criteria described above end up filtering out documents containing the exact match in favor of documents containing a higher proportion of synonymous words. It is not clear that this is a desirable result from the standpoint of an end-user who is particularly interested in the exact word used for the query. Turtle's system does not take grammatical structure into account; in fact, it does not take adjacency information into account, since each document is treated as a "bag of words," with no preservation of order information.
U.S. Pat. No. 4,270,182 to Asija discloses a system for asking free-form, un-preprogrammed, narrative questions. The system of Asija accepts unstructured text from multiple sources and divides the text into logical information units. These logical information units may be sentences, paragraphs, or entire documents; each logical information unit is assigned a unique identification number, and is returned as a whole when it is selected for retrieval. The retrieval system of Asija uses standard keyword-based lookup techniques.
The procedure of Asija only applies to the logical information units, which are ranked as equally relevant at the end of a preceding stage. Both synonyms and searchonyms are considered as equivalent to query words found within the logical information units. The net effect of the ranking and filtering process of Asija is to order documents by maximizing the number of query words matched, followed by the number of instances of query words. Furthermore the Asija system does not take grammatical structure into account. In addition, synonyms are not exact matches for queries, and thus should be ranked lower. The Asija system also only makes use of literal text strings, as all synonyms must be specified by dictionary files that list text strings as equivalent.
A key feature of the present invention is the unique and novel method of representing text in the form of numerical vectors. The vectorization techniques of the present invention offer several advantages over other attempts to represent text in terms of numerical vectors. First, the numbers used are ontologically generated concept representations, with meaningful numerical relationships such that closely related concepts have numerically similar representations while more independent concepts have numerically dissimilar representations. Second, the concepts are represented in the numerical form as part of complete predicate structures, ontological units that form meaningful conceptual units, rather than simple independent words. Third, the vectorization method and system described herein provides a way to represent both large portions of long documents and brief queries with vector representations that have the same dimensionality. This permits rapid, efficient relevancy ranking and clustering by comparing the query vectors with substantial portions of documents, on the order of a page or more at a time, with no loss of accuracy or precision. Furthermore, it permits comparisons of large-scale patterns of concepts across entire documents rather than the small moving windows used in prior systems. These advantages provide the present method and system with unique performance and accuracy improvements over conventional systems.
The basic premise of relevancy ranking and clustering is that a set of documents is sorted or ranked, according to certain criteria and clustered to group similar documents together in a logical, autonomous manner.
The relevancy ranking and clustering method and system of the present invention scores documents by word meaning and logical form in order to determine their relevance to the user's query. It also compares patterns of concepts found within documents to the concepts within the query to determine the most relevant documents to that query.
As part of the relevancy ranking and clustering method and system, documents and user queries are first parsed into ontological predicate structure forms, and those predicate structures are used to produce a novel numerical vector representation of the original text sources. The resulting vector representations of documents and queries are used by the relevancy ranking unit and the document clustering component of the present invention to perform the ranking and clustering operations described herein. The unique and novel method of producing the vector representations of documents and queries provides efficiency, accuracy, and precision to the overall operation of the relevancy ranking and clustering method and system.
Input queries and documents are parsed into one or more predicate structures using an ontological parser. An ontological parser parses a set of known documents to generate one or more document predicate structures. Those predicate structures are then used to generate vector representations of the documents and queries for later use by the ranking and clustering method and system.
The ranking and clustering method and system performs a comparison of each query predicate structure with each document predicate structure, and of document vectors to query vectors, to determine a matching degree, represented by a real number. A multilevel modifier strategy is implemented to assign different relevance values to the different parts of each predicate structure match to calculate the predicate structure's matching degree.
When many documents have a high similarity coefficient, the clustering process of the relevancy ranking and clustering method provides a separate, autonomous process of identifying documents most likely to satisfy the user's original query by considering conceptual patterns throughout each document, as opposed to individual concepts on a one-by-one basis.
The relevancy ranking and clustering method and system of the present invention provides a fine-grained level of detail for semantic comparisons, due to the fact that conceptual distance can be measured and weighted absolutely for all terms within a query. In addition, the relevancy ranking and clustering method and system of the present invention provides a sophisticated system for ranking by syntactic similarity, because syntactic evaluation occurs on lists of predicate arguments. The manner in which the arguments are derived is irrelevant, and can be accomplished through any syntactic parsing technique. This provides a more general-purpose ranking system.
The relevancy ranking and clustering method and system of the present invention ranks according to grammatical structure, not mere word adjacency. Thus, a passive sentence with more words than an equivalent active sentence would not cause relevant documents to be weighted lower. The relevancy ranking and clustering method and system of the present invention makes use of actual word meaning, and allows the user to control ranking based on word similarity, not just presence or absence.
The relevancy ranking and clustering method and system of the present invention also ranks according to conceptual co-occurrence rather than simple word or synonym co-occurrence as is found in other systems. This provides the advantage of recognizing that related concepts are frequently found near each other within bodies of text. The relevancy ranking and clustering method and system furthermore considers overall patterns of concepts throughout large documents and determines matches to query concepts no matter where in the document the matches occur.
The relevancy ranking and clustering method and system additionally provides simple and efficient means of recognizing that frequency of occurrence of concepts within a document often correspond to relative importance of those concepts within the document. The present invention autonomously recognizes frequently occurring query concepts located within a document and judges such documents as more relevant than documents in which the query concepts occur only rarely. The autonomous and efficient method of accomplishing this is based both on the unique vectorization techniques described herein and on the operation of the ranking and clustering method and system.
The relevancy ranking and clustering method and system of the present invention allows the user to specify whether documents similar to a particular document should be ranked higher or lower, and automatically re-ranks such documents based on a neural network. The neural network provides a coordinate system for making such judgments in an autonomous and non-subjective fashion, which does not require trial-and-error efforts from the user. Finally, there is no code generation or recompilation involved in the present system, which only performs the needed document clustering once; requests for similar or different information return a different segment of the result set, but without recomputing the relations between all the documents, as is required in a spreadsheet-like or other statistical approach.
The relevancy ranking and clustering method and system of the present invention uses grammatical relationship information to adjust ranking relations. Although words do not need to be grammatically related to each other within a document to include the document in the result set, such relationships serve to adjust the rankings of otherwise similar documents into a non-random, logical hierarchy. Furthermore, each word within the present system is a meaningful entity with mathematically meaningful distances relative to other concepts. Thus, synonyms are not treated as probabilistically equal entities, but are assigned lower rankings depending on how far they are from the exact query word given by the user.
Documents containing sentences that logically relate query terms are ranked higher than documents which simply contain instances of those terms. Similarly, thesaurus-like query expansion is made possible through the use of ontologies, and the present ranking system enables similar concepts to be graded according to the degree of their similarity. This capability represents a significant innovation over other purely statistical techniques.
In addition to giving higher weights to documents where search terms occur in close proximity, the relevancy ranking method and system of the present invention is able to make further discrimination by whether or not the search terms are bound together in a single predicate within a document. Additionally, the relevancy ranking and clustering method and system of the present invention is capable of discriminating between documents based on conceptual similarity so that conceptually similar, but inexact, matches receive lower weights than exactly matched documents.
In the relevancy ranking and clustering method and system of the present invention, the vector representations of individual documents and user queries are based not on individual words but on patterns of conceptual predicate structures. Dynamic alteration can be made to the content of the document sets, thus allowing the relevancy ranking and clustering method and system to begin its processing even before the search for potential matching documents is complete.
As a result, the relevancy ranking and clustering method and system of the present invention provides an automatic process to cluster documents according to conceptual meanings. The present system is designed to make fine discriminations in result ranking based on the degree of conceptual similarity between words, i.e., exactly matched words result in higher rankings than synonyms, which in turn result in higher rankings than parent concepts, which in turn result in higher rankings than unrelated concepts.
These and other attributes of the present invention will be described with respect to the following drawings in which:
The relevancy ranking and clustering method and system of the present invention is intended, as one example application, to work with the concept-based indexing and search system set forth in co-pending patent application Ser. No. 09/627,295, which indexes collections of documents with ontology-based predicate structures through automated and/or human-assisted methods, and which is incorporated herein by reference. The relevancy ranking and clustering method and system can also be used with other document indexing and information retrieval systems, including question-answering systems, as described below.
In one example application of the present invention as embodied as part of a concept-based indexing and search system, a user can make queries in the form of natural language, keywords, or predicates. Queries are converted into ontology-based predicate structures, if necessary, and compared against documents, which have been previously parsed for their ontology-based predicates, to obtain the best possible matching documents, which are then presented to the user.
The transformation of natural language sentences into predicate structures is performed by an ontological parser, as set forth in co-pending patent application Ser. No. 09/697,676, and incorporated herein by reference.
Predicate structures are representations of logical relationships between the words in a sentence. Every predicate structure contains a predicate, which consists of either a verb or a preposition, and a set of arguments, each of which may be any part of speech. The ontological parser converts a series of sentences first into a collection of parse trees, and then into a collection of completed predicate structures.
Ontologies are hierarchies of related concepts, usually represented by tree structures. The ontology-based parser for natural language processing application set forth in co-pending patent application Ser. No. 09/697,676, introduces a new implementation of this tree structure. The proposed data structure consists of an integer value, where each digit of the integer corresponds to a specific branch taken at the corresponding level in the tree.
The relevancy ranking and clustering method and system consists of three major units that work together to provide the required ranking and clustering services. The block diagram in
The first unit of the present system, the vectorization unit transforms the representations of documents and queries into a vector form. In order for the parsed documents and queries to be used in the document clustering component and in portions of the relevancy ranking unit, the documents and queries must be represented as multidimensional numerical vectors. These vector representations provide the means of efficient comparison between the documents and the query. An individual document may be represented by a single document vector, or it may be represented by a collection of document vectors, depending on the parameters of the vector representation process and the length of the document. Queries are typically very brief, usually containing only one, or possibly a few predicate structures. Documents, on the other hand, typically contain tens or even hundreds of predicate structures. Despite this disparity in the amount of information to be converted to vector representation, it is essential that both query vectors and document vectors have exactly the same number of vector elements in order for comparisons between the two to be valid.
The vectorization unit of the present system provides an innovative and unique process for: (a) converting the text of documents and queries into multidimensional numerical vectors; (b) ensuring that those vector representations are appropriately normalized for use in document-to-query comparisons; and (c) guaranteeing that no matter how long the document and how short the query, all such vector representations have exactly the same dimensionality. This vectorization process thus provides the basis for the further comparison of documents and queries through processes as typified by the document clustering component and the relevancy ranking unit. However, the vectorization method described here can also support other methods of comparisons that have similar vector representation requirements.
The vectorization unit has two configurations, a document vectorization unit 130 and a query vectorization unit 134. Each of these configurations converts ontologically parsed text into vector representations. The document vectorization unit 130 converts the set of predicate structures derived from ontologically parsing a document into one or more large-dimensioned numerical vectors. The query vectorization unit 134 performs the same task for an ontologically parsed user query. The resulting vectors are saved along with the predicate structures they were derived from in the corresponding document predicate storage unit 124 and query predicate storage unit 126. These vectors are used by the remaining two pieces of the present system, the relevancy ranking unit 128 and the document clustering component 140.
The second piece of the present system, the relevancy ranking unit 128, provides concept-by-concept comparison of individual predicate structures to a user's query. It also provides a coarse-grained relevancy estimate by comparing an overall pattern of predicate structures in the document to the user's query.
The third piece, the document clustering component 140, does fine-grained discrimination when many documents appear to be close matches to the user's query. This portion of the present method and system identifies groupings of such matching documents and provides a feedback method to rapidly identify which grouping or groupings are most applicable to the user query. Each of these three major units of the relevancy ranking and clustering method and system will be discussed in detail below.
The document vectors are generated by the document vectorization unit, 130, illustrated in
The first step in vectorization of documents occurs when the ontological parser 122 originally processes the documents and their corresponding predicate structures stored in the document predicate libraries, as illustrated by document vectorization unit block 130 in
The predicate structures in the document predicate library are each identified by a predicate key. The predicate key is a fixed-length integer representation of the predicate, in which conceptual nearness corresponds to numerical nearness. Thus, a simple subtraction operation yields a rough estimate of the relative conceptual nearness of the predicates. For example, the integer representations for "give" and "donate" are conceptually nearer than the representations for "give" and "purchase," and thus, the difference between the integer representations of "give" and "donate" is smaller than the difference between the integer representations of "give" and "purchase."
One or more multi-dimensional vectors are constructed for each document 120 using the integer representations of the predicate structures identified within the document 120 to perform vector relevancy matching for each document 120, in block 132 of
In the case where a fixed number of arguments are used, any predicate structure with fewer than that number of arguments uses zeros in the remaining unfilled argument positions. Any predicate structure with more than the specified number of arguments fills the argument positions until argument positions are all filled; remaining arguments are ignored and omitted from the vector representation. Thus, if exactly two arguments are to be included from each predicate structure, a predicate structure with only one argument would insert a 0 for the second position. A predicate structure with three arguments would include the first two and omit the third.
The result of this process is an N-dimensional vector representation of that document 120, where N=M if only the predicate portion of the predicate structures are used, and N=q*M if a fixed number of arguments (q−1) from the predicate structures are included. This is a design choice or system parameter. In most practical applications, N will typically be a moderately large number, on the order of 50 to 100, although there is no conceptual limit on its size. However, there may be some performance degradation, as N grows larger.
In another embodiment, to perform vector relevancy matching of longer documents, a document 120 may be represented by multiple vectors instead of only one. Thus, the first N predicates, optionally including a fixed number of arguments for each predicate, are used for the first vector representation, the next N predicates and arguments are used for the next vector representation, and so on, until there are fewer than N unused predicates and arguments remaining. For the final vector, the last N predicates and arguments are used, even if there is some overlap between this vector and the immediately previous vector.
Once the vectors that represent a document 120 are composed, each must be normalized to a fixed vector length. Normalization can be performed using any of a variety of well-known and established techniques. It is not necessary that normalization be performed to a unit-length vector; any constant length is acceptable. A typical simple normalization technique to a unit-length vector is to divide each vector element by the length of the original vector, as illustrated in the following equations:
This is only one example of normalization. As those familiar with the art are aware, other well-understood possibilities can be used. The result of the normalization operation is a set of one or more normalized document vectors that represent the pattern of concepts identified within each document.
The normalized document vectors are typically stored along with the predicate structures for that document at the time the documents are originally parsed by the ontological parser. As a result, efficiency is increased since the vectors do not have to be repeatedly constructed with each access to the document.
In addition to the document contents, vectorization must be performed on the user query by the query vectorization unit 134. However, this can present a problem because a user query will typically consist of only one or possibly a few conceptual predicate structures compared to the many predicate structures found in a typical document. As a result, while the normalized document vectors may reflect perhaps 50 or 100 predicate structures, the user query may have as little as a single predicate structure to work with.
In this case, the query predicate structure or structures are repeated enough times to make up the total number of elements needed to construct a vector of exactly the same dimensionality as the normalized document vectors. Like the document vectors, the query vector must be normalized; this is done using the same normalization process used in normalizing the document vectors. The final result is a normalized query vector.
If the query has more than one predicate structure, multiple query vectors can be constructed with the individual query predicate structures in various orders. Thus, if the query consists of two predicate structures, A and B, two query vectors can be constructed, one with the predicate structures ordered as
and one with the predicate structures ordered as
The vector matching unit and the document clustering component can then operate on each of these query vectors in turn.
Relevancy ranking, the second major component of the relevancy ranking and clustering method and system, is a process that produces a set of documents sorted or ranked, according to certain criteria. The relevancy ranking process, according to the present invention, uses a similarity comparison algorithm to determine the relevance of a document to a query. One or more query predicate structures are generated using an ontological parser to parse input queries. One or more document predicate structures similarly are generated using an ontological parser to parse the set of known documents. Each query predicate structure is compared with each document predicate structure to determine a matching degree, represented by a real number. A multilevel modifier strategy is used to assign different relevance values to the different parts of each predicate structure match to calculate the matching degree of each predicate structure. The relevance of a document to a user's query is determined by calculating the similarity coefficient, based on the structures of each pair of query predicates and document predicates.
The relevancy ranking unit comprises multiple components that perform different levels of similarity comparison. The first component is a predicate vector matching unit that dynamically compares the coarse-grained overall pattern of predicate structures for each document to those of the user query and returns a ranking by predicate pattern similarity. The second component is a predicate structure matching unit that compares two predicate structures and returns a similarity measure. The third component is a predicate matching unit that compares the similarity between the predicate parts of two predicate structures and returns a similarity measure. The fourth component is an argument matching unit that compares the argument parts of two predicate structures and returns a similarity measure. The fifth component is a concept matching unit that compares two concepts and returns a similarity measure. Finally, the sixth component is a proper noun matching unit that compares two proper nouns and returns a similarity measure.
The relevancy ranking unit considers a set of factors that impact the ranking algorithm, and implements a multiple-level modifier strategy to adjust the weight of each factor.
There are six steps in the relevancy ranking method of the present invention. First, a group of candidate documents 120 are sent to the ontological parser 122. Second, the ontological parser 122 parses each document 120 and generates one or more predicate structures for each sentence in the document. The set of predicate structures from a document 120, along with one or more document vectors produced by the document vectorization unit 130 are stored in a document predicate storage component or library 124. The document predicate library contains a formal representation of the document 120 by storing the set of predicate structures representing the sentences in the document 120. The document predicate library for each candidate document 120 is stored in a document predicate storage component 124 and can be retrieved by a primary key. Third, an input query 118 is sent to the ontological parser 122. Fourth, the ontological parser 122 parses the input query 118 and generates one or more predicate structures. All predicate structures from the input query 118 are represented in a query predicate library that is stored in a query predicate storage component 126. Fifth, a query predicate library (representing an input query 118) and a set of document predicate libraries (representing a set of documents .120) are sent to the relevancy ranking component 128 to compare the similarity level between an input query 118 and the documents 120. Documents 120 are then ranked in the order of their similarity levels. Sixth, the documents 120 are returned in ranked order.
The vector relevancy matching component of the relevancy ranking unit provides an efficient, computationally concise ranking of the documents based on the predicate structures from those stored for the documents 120. This matching technique uses primarily the predicate portions of the stored information, and thus does not do fine-scale ranking. It makes use of the vectors produced by the document vectorization unit 130 and the query vectorization unit 134 to perform its ranking operations.
The operation of the vector matching unit is illustrated in
The predicate vector matching implemented by the relevancy matching component has the following inputs:
Query_predicateLibrary: a query predicate library structure representing an input query and containing all predicate structures generated by the ontological parser from parsing the input query, and
Doc_predicateLibrary: a document predicate library structure containing the set of predicate structures representing the sentences in the natural language source document.
Query predicates are converted into a queryvector. For each document inside the Doc_predicateLibrary the corresponding documentvector(s) are retrieved. The dot product of the queryvector and the documentvector is computed. The matching_score is made equal to the dotproduct. The document is inserted into the ranking list, with the highest dotProduct values first, and the lowest dotProducts last.
The output of the predicate vector matching algorithm is a ranked list of documents with the closest-fit documents at the top of the list and the worst fit documents at the bottom of the list.
For more fine-grained relevancy ranking, other techniques used by the relevancy ranking component are used to perform one-to-one comparisons of the predicate structures within the documents to the predicate structures within the query. These other techniques are explained next.
Since both input queries and documents are converted into one or more predicate structures, the similarity between an input query and a document depends on the similarity between query predicate structures and the document predicate structures. There are different strategies for matching two predicate structures when they are similar but do not exactly match.
As described previously, a predicate structure consists of a predicate, which is either a verb or a preposition, and a set of arguments, which may be any part of speech. Two predicate structures can be matched, in the predicate matching step 136, by comparing their verbs in a verb (preposition) only match, where only the predicate part (usually a verb or a preposition) of two predicate structures is compared. A noun match may be performed if two predicate structures do not match in their predicate part, wherein their respective arguments are compared for matching nouns. A verb and noun match compares the whole predicate structure.
In order to precisely determine the information converted by the predicate structure, a multiple level modifier strategy 138 is implemented to adjust the weight for each factor that modified the information converted to the predicate structure. Modifiers are defined based on a number of factors.
One factor is the predicate structure abstraction level. The predicate structure abstraction is represented by the predicate structure match type. A "Verb Only Match" is more abstract than a "Noun Match." Similarly, a "Noun Match" is more abstract than a "Verb and Noun Match." The parameters VerbOnlyMatchModifier, NounModifier and VerbNounMatchModifier are defined to adjust the weight of different predicate structure abstraction levels. The more abstract a match type, the smaller the weight it receives.
Another factor is concept proximity, which represents the ontological relationship between two concepts. Each concept in a parse tree can be represented as an integer. The smaller the difference between two concepts, the closer their ontological relationship is. The closer the ontological relationship, the higher the relevancy bonus. For two exactly matched concepts, the parameter ConceptExactMatchModifier adjusts the weight. The parameter ConceptProximityModifier adjusts the weight for two concepts that are not exactly matched. Each concept node in the ontology hierarchy tree has a unique integer identifier, and all of these numbers have the same number of digits. Thus, the value of identifier_digit_number represents the number of digits the integer identifier has, and the variable highest_order_difference_digit represents how many digits the difference between two concepts has. The modifier weight for ConceptProximityModifier is defined as
Sentence position is another factor, which postulates that sentences appearing early in a document may contain the title or abstract of a document, and predicates containing the title or abstract will have a higher information content. FrontLineModifier is defined for predicate structures representing one of the first ten sentences in a document.
Another factor is the degree of proper noun matching. This factor considers the similarity between two proper nouns. ProperNounExactMatchModifier is defined to modify the matching degree between two exactly matched proper nouns, and SymbolMatchModifier is defined to modify the matching degree between two proper nouns in which one is the symbol of the other.
Word stem is a factor that takes in to consideration whether two words are from the same word stem. For example, the word "sleeps" and "sleepy" have the same word stem, "sleep." SameStemModifier is defined to adjust the matching degree of two words having the same word stem.
Document size is a factor that takes into account the size of a document. A DocSizeModifier parameter is designed to prevent a large number of predicate occurrences in a document from over-weighting the matching score. A short document containing 10 instances of a query predicate structure will be given a higher weight than a much longer document with 10 instances of the same query predicate structure.
Table 1, shown in
The similarity comparison process implemented by the relevancy ranking component determines the similarity between a query and a document. The inputs to this algorithm are:
Query_predicateLibrary: a query predicate library structure representing an input query and containing all predicate structures generated by an ontological parser from parsing the input query,
Doc_predicateLibrary: a document predicate library structure containing the set of predicate structures representing the sentences in the natural language source document, and
Match_type: a representation of the predicate structure match type.
The output of this algorithm is a real number representing the similarity level between a query and a document.
If a noun match is desired, the predicate parts are extracted in step 206 to provide two predicates 208. If the two predicates 208 match in step 210 the result is returned in step 212. If the two predicates 208 do not match the arguments are extracted from the predicate structures in step 214, and the arguments are matched in step 216. Matching arguments are sent to an argument matching unit and to the degree of matching calculation step 218.
If only a verb match is desired, the predicate parts are extracted in step 220 to provide two predicates 222. If the two predicate parts 222 match in step 224 the matching predicates are sent to a predicate matching unit in step 225 and to the degree of matching calculation step 218.
If both verb and noun matches are desired, the verbs are matched in step 226, and steps 220 to 225 are followed. The nouns are then matched in step 228, and steps 206 to 218 are followed. Furthermore, after the noun matching step 228 and the verb matching step 224, the degree of matching is calculated in step 219.
The procedures to determine the degree two predicate structures match are described below. A determination is made whether the two predicate structures are an exact match, namely do the query predicate structure and the document predicate structure match exactly. If there is an exact match then the matching degree is set to equal the predicate Structure Exact Match Modifier. If the two predicate structures do not match exactly then a determination is made of the matching degree based on the input predicate structure match type.
If only the verbs match, the value Sverb is set to equal verb_only_match between the query predicate structure and the document predicate structure. The matching_degree is then set equal to the product of the VerbOnlyMatchModifier and the Sverb.
If only the nouns match, the value Snoun is set equal to noun_match between the query predicate structure and the document predicate structure. The matching_degree is then set equal to the product of the NounOnlyMatchModifier and Snoun.
If both the nouns and verbs match, the value Sverb and Snoun are set to equal verb_only_match and noun match, respectively, between the query predicate structure and the document predicate structure. The matching_degree is then set equal to the product of the NounOnlyMatchModifier and Snoun. plus Sverb.
When only the verbs of the two predicate structures match, the matching function is as follows. First, the predicate part is extracted from each predicate structure to generate two predicate objects, query_predicate and doc_predicate. Second, the two extracted predicate objects are sent to a predicate match unit, which returns a matching score of the two predicates.
When only the nouns of the two predicate structures match, the matching function is as follows. First, the predicate part from each predicate structure is extracted and two predicate objects are generated, query_predicate, doc_predicate. Second, a determination is made as to whether the two predicate objects exactly match. If the two predicate structures exactly match, the score is set equal to the predicate Exact Match Modifier. Otherwise, arguments are extracted from each predicate structure and two argument lists, query_argument_list and doc_argument_list are generated. The two argument lists are then sent to an argument matching unit, and a matching score for the two argument lists is returned.
If the result of step 336 is negative, a determination is made whether the two arguments are both proper nouns in step 338. If both arguments are proper nouns, the concepts are sent to the proper noun matching unit in step 339. If both arguments are not proper nouns, concepts are extracted from each argument, and two concepts are generated in step 340. The two concepts are then sent to a concept matching unit in step 341.
The third major component in the relevancy ranking and clustering method and system is the document clustering component. In any sufficiently extended document space, it is likely that generally worded queries will result in far too many exact or nearly exact matches. It is commonly found that users who are presented with a long list of matches from a document retrieval process rarely look past the first 25 or 30 such matches. If the list exceeds that length, all other matches will be ignored. Yet it is also true that a query worded with too much generality can easily retrieve many times that number of documents from even a moderately large search space, all of which conceivably provide an exact predicate match for the user query. In these cases, the document clustering component is used to further distinguish the found documents and identify the exact ones that provide the requested information.
The document clustering component comprises a self-organizing neural network that self-organizes based on the set of documents returned by the relevancy ranking unit as being exact or near-exact matches to the user query. The self-organization results in the identified documents being clustered based on their patterns of predicate pairs as discovered during the search process. The document clustering component then compares the user query predicate structure to the resulting self-organized map, identifying clusters of documents that are most likely to fit the user's intent. The document clustering component provides a feedback mechanism by which users can determine if the identified cluster(s) of documents are good fits. This process also rapidly focuses on the correct cluster, whether or not the originally chosen cluster is correct.
The purpose of the document clustering component is to identify the exact documents desired by the user with the greatest possible confidence and the minimum possible time and effort on the part of the user. In effect, the document clustering component organizes returned documents into similarity clusters, which clusters are themselves organized by similarity. This organization and clustering process is performed automatically, without the need for humans to determine content or topic for the clustered documents.
Users may direct attention to one or a subset of clusters, and the document clustering component can thus rapidly and efficiently return only those documents desired, even when the original user query was too broadly worded to accurately focus the search effort.
The document clustering component operates in two modes. In the self-organization mode it adapts to the collection of identified documents matching a specific search effort. In the cluster retrieval mode it identifies appropriate cluster(s) of documents and returns them to the user, thus refining the search effort to more specifically respond to the user's needs.
Document clustering using the document and query vectors produced by the previously described vectorization techniques achieves several key advantages. First, it takes advantage of the basis for proximal concept co-occurrence in a more effective way than looking for simple word repetitions. Often authors of documents try to avoid too much repetition of the same term because human readers perceive such a writing style as repetitious and boring. Thus, a document dealing with housing might refer to "abodes," "houses," and "residences" within a single sentence or paragraph. Simple proximal word co-occurrence does not acknowledge that these are virtually the same concept. The use of ontology-based conceptual predicates identifies all such terms as identical or with numerical representations that vary only slightly from each other. Thus the notion of proximal concept co-occurrence provides much greater power than the simpler proximal word co-occurrence used in other systems.
The second key advantage notes that frequency of concept is clearly related to importance within a discussion. Because the normalized query vector, in effect, repeats the query concept or concepts many times, it can identify similar concepts located throughout the normalized document vectors. As a result, documents that have a high frequency of occurrence of the query concept are more likely to be returned by the document clustering component than documents that mention the query concept only rarely.
A further advantage of this vectorization technique is that it reflects the reality that a given query concept may appear in many possible positions within the document, not merely in the first sentence, or even the first paragraph. The replication of the query concept throughout the query vector in effect checks for this concept in almost every possible location within the document. There thus is no penalty to documents that have the relevant discussion further down in their text. Those documents that are the most relevant-documents containing discussions of the query concepts more frequently-are returned.
These two modes make use of any of several self-adaptive neural network structures. A neural network is a computational system that uses nonlinear, non-algorithmic techniques for information processing. Although the neural network structure specified herein is illustrative of the type of neural network architecture and learning algorithm that may be used in this component, the scope of the present invention is not intended to be limited to the specific embodiment disclosed herein, as alternative embodiments will be obvious to one skilled in the art. For example, one or more aspects of the present invention may be computer executable instructions stored on one or more computer readable media.
A neural network generally consists of a large number of simple processing elements, called neurodes 400 herein.
Typically, the neurodes 400 of a neural network are organized into layers as illustrated in
Once the document set 502 is vectorized, training can begin. (As noted in the previous section, the vectorization step is normally done at the time the document is placed in the document predicate storage 106.) Training occurs using a self-organizing feature map 504 of arbitrary size. Typically, the size of the map 504 will be determined based on (a) the number of categories desired as determined by pre-established system parameters; (b) the size of the document set 502; and (c) the desired granularity of the categories. The number of neurodes in the feature map 504 can either be fixed as a system parameter, or dynamically determined at the time the map is created.
Once the feature map is prepared, the final step is to determine which cluster or clusters should be returned to the user, and which document within that cluster should be specifically used as an example. As noted previously, several techniques exist to make these decisions, and the best one will be predicated on the needs of the specific application. One technique is discussed herein to illustrate how this process is performed, however, it is not meant to limit the scope of the present invention.
One useful method to determine the cluster and document is to make use of the query vector produced in the vectorization process. The normalized query vector is applied to the feature map, in the same manner as the document vectors were. The neurode with the weight vector that produces the largest dot-product computation with this query vector is the "winner." That neurode has a list of associated documents produced during the final processing stage of training. Those documents (in a very large document set) are the cluster most closely associated with the concepts in the query. Thus, that cluster is the one that should be presented to the user. In a smaller document set, the documents from that neurode and its immediately neighboring neurodes constitute the winning cluster.
It is also possible to present the user with several choices of clusters by retrieving the cluster that the query most closely matches, and one or more clusters represented by neurodes at greater distance from the winning neurode. For example, if the system is set to return four clusters for the user to select among, the winning neurode defines the first cluster, and the remaining three clusters are represented by neurodes approximately equally spaced throughout the physical network. Clearly, any desired number of cluster choices can be selected, up to the total number of neurodes within the self-organizing layer, depending on system application and utility. The result, no matter how many clusters are chosen, is a small set of documents that effectively spans the conceptual space of the document set.
As shown in
In one implementation of the self-organizing network described, the network's key processing layer, called the self-organizing layer, includes connections not only to other layers, but also to other neurodes within the self-organizing layer. The activity of the self-organizing layer is mediated by a secondary competition effect.
The intralayer, i.e., from a self-organizing layer neurode to other neurodes within that layer, connections mediate the competition. Weights on the intralayer connections between two arbitrary neurodes vary with the physical distance between the neurodes so that immediate physical neighbors generate positive, stimulating signals (i.e., over positively weighted connections), while neighbors further apart generate negative, inhibitory signals (i.e., over negatively weighted connections). Those neurodes at the farthest distances (such as neurodes along the physical edges of the layer of neurodes) provided a slight positive stimulation. The net effect is that an input signal arriving at the self-organizing layer results in an intralayer competition that ensures a single, best-match neurode wins. Only that winning neurode generates an output signal to pass on to the following layer of neurodes. In essence, the activity of all other neurodes is damped by the competition with the best-fit winning neurode.
Alternative implementations of such a self-organizing map as a computer program do not require exact simulations of such competition; it is enough that the end result is produced. For each input signal pattern, the only output signal comes from the single neurode that best matches that input pattern as determined by the dot product of the input pattern vector (normalized) and the corresponding (initially normalized) weight vector of the neurode.
The overall geometry of the self-organizing layer is one of a continuous strand of neurodes. Immediate neighbors of each neurode are those on either side of it according to the virtual intra-layer connections shown. The size of the neighborhood around each neurode is a parameter that is varied in the course of training. Typically, the initial size of the neighborhood is fairly large so that as much as 25-50% of the total self-organizing layer constitutes the neighbor of any given neurode. As training proceeds, this neighborhood size is rapidly lowered until it reaches 1 or 0, at which point only the single winning neurode adjusts its weights.
The overall training process for a given set of document vectors, D={I1, I2, . . . , In} includes initializing the self-organizing layer of the network. Initialization includes determining the size of the self-organizing layer, either from a fixed system parameter, or from dynamic considerations such as the total number of document vectors within D. For the following discussion, the size of the self-organizing layer is referred to as M.
An initial set of weight vectors is then established for each neurode in the self-organizing layer. These are the weights associated with the connections between the input layer and the self-organizing layer. Note that the dimensionality of these weight vectors is always exactly the same as the dimensionality of the document vectors since there is always exactly one input connection for each element of the document vectors. For the initial weight set, the M weight vectors are either set to random weights or to the first M input vectors in D.
When the total number of document vectors in D is very large, the second choice may be most appropriate, since the second choice guarantees that every neurode accurately reflects at least one input vector. However, in smaller document vector sets, the second choice can unfairly bias the self-organizing map toward those documents that (by chance) happen to occur early in the document set. The random process is safer, but somewhat more computationally expensive; setting the weights to members of the document vector set is computationally cheap but may impose some unwanted bias on the feature map.
Once the initialization is complete, the actual training process starts. An input vector In is applied to each neurode in the self-organizing layer. The closeness of the weight vector of each neurode to the input vector is determined by computing the dot-product of the two vectors. Next, the neurode with the largest result of the dot-product computation is determined and is declared the "winner." This computation is computed as:
In this equation, the nth input vector and the mth neurode's weight vector are dotted. The dimensionality of each of these vectors is k (i.e., there are k elements in each of the input vector and the weight vector).
The formula for the dot product of an input vector I and a weight vector W is:
The weight vectors of the winner and each of its current neighbors, as determined by that neighborhood size are then modified based on the current (and dynamically changing) neighborhood size. The weight vectors are modified as follows:
Where � is a learning parameter between 0.0 and 1.0. Typically, this parameter is on the order of 0.25 or less, though its value may also be dynamically changed during the course of the training.
The process then continues to the next input vector, repeating the foregoing steps. Training proceeds and the neighborhood size is decreased until the complete document set is processed. For very large document sets, a single pass through the data may suffice. For smaller sets, the training process can be iterated through the document set as necessary.
Because this training is computationally extremely simple, it can be performed very quickly. Furthermore, the training process can begin even as the search process continues since documents can be incrementally added to the document set without loss of performance.
The foregoing process produces a self-organized feature map that has clusters of neurodes representing conceptual clusters of the documents in the feature set. Neurodes that represent documents that are conceptually near will themselves be physically near within the feature map (where "nearness" within the feature map is determined by the neighborhood distance within the network). One additional pass through the input vectors can now be done without doing further modifications to the feature map. The purpose of the final pass is to make a list of which documents correspond to which winning neurode in the final map. Thus, there is an internal list associated with each neurode that notes for which documents that neurode is the "winner."
The single winning neurode represents the best match between the input signal and the currently organized network's set of weight vectors. In n-dimensional weight-space, the input vector and the weight vector of the winning neurode most nearly point in the same direction (i.e., have the maximum cosine of the angle between the two vectors). The normalization of the input vectors (i.e., the stored document vectors) and initial weight vectors is important because this implies that the lengths of the corresponding input and weight vectors is constant to an arbitrary length, usually, though not necessarily, 1.0. This also implies that the normalization process used on the document and query vectors is the same normalization process that must be used on the weight vectors in the neural network. Additionally, issues of dimensionality and scale are avoided via the normalization procedure.
In a typical implementation of the neural network architecture, the winning neurode and, possibly, some of its immediate physical neighbors adjust their weight vectors according to any of several learning laws. The simplest of these is
The determination of which, if any, of the winning neurode's physical neighbors should adjust their weight vectors according to this scheme is part of the self-organizing process. Typically, the initial number of the adjusting neighbors is a substantial fraction of the network as a whole, thus ensuring that all neurodes participate in the self-organizing process. As self-organization proceeds and additional input vectors are presented to the network, this number is reduced until only the winning neurode adjusts its weight vector.
With a sufficiently large collection of documents on which to self-organize, it is possible for the self-organization step to proceed in an incremental fashion, as potentially matching documents are identified and added to the document set. If the set of documents is moderate in number (though still too many to return to the user directly), the system can perform the self-organization step by iterating through the set of returned document vectors until an appropriate level of clustering is achieved.
The total number of clusters possible within the neural network is limited to the total number of neurodes in the self-organizing layer. This is a definable parameter and may vary depending on specific application needs.
Unlike other document search and retrieval systems, the present system considers the overall pattern of predicate structures across substantial portions of the document to determine the overall meaning of the document. The predicate structures derived from the ontological parser are combined into a moving window of fixed but arbitrary size, with each predicate structure providing a fixed number of input vector elements. The resulting input vector provides an encoding of the relationship of predicate structures to each other within the document. This pattern of predicates permits the document clustering component to self-adapt to the overall meaning of the documents being learned.
Because the documents used for training consist of those documents returned by the ontological parsing system as matches for the specified query, the training results in a clustering of the documents into "more similar" and "less similar" categories because the self-organizing neural network after training has the following characteristics:
Once the Document Clustering Component has produced a neural network trained to distinguish the documents returned by the earlier search effort, it is ready to be used to determine the exact document(s) needed by the user. This is done in cluster retrieval mode by presenting users with one or, possibly, a small selection of documents that represent the corresponding document clusters. Such documents are considered by the system as being "typical" of the documents within that cluster. Although additional processing of the clusters can be performed to further refine the separation, it is not necessary in most instances.
Users can determine whether the presented sample document or documents are either similar to the requested documents or not similar to the needed documents. Based on that selection, the appropriate document(s) are provided. In the case where the user indicates a presented document is similar to desired documents, documents within the selected document's cluster are returned to the user. When the user indicates a presented document is dissimilar to desired documents, one or more sample documents from one or more clusters far from the presented document are provided for similar rankings. Because the document clustering component has positioned the sample documents within similarity clusters, and because those similarity clusters are themselves arranged in order of similarity, it is a near-certainty that appropriate documents are returned to the user within one, or at most a few, iterations of this user selection procedure. The latter case will occur only when an extremely large set of documents is returned by the search effort.
The determination of the cluster from which to select a sample can be performed in a variety of ways, based on computational needs and other user-defined parameters. Typical methods include but are not limited to, returning one sample document from each cluster, returning one sample document from the cluster most closely matched by the user's original query, returning one sample document from only the largest cluster, and returning one sample document from a randomly selected cluster.
Any of the foregoing methods can be used, along with other suitable methods, depending on system performance requirements and user preferences.
The determination of the specific sample document to select from a cluster can also be made in a variety of ways, based on specific user and system needs. Typical choices include, but are not limited to, returning a random document from the cluster, and returning the document closest to the center of the cluster.
Returning a random document is computationally simple and would be applicable in situations where performance is a concern. The second method involves computing the center of the cluster of documents using any of several well-understood mathematical formulations, and then returning that document or documents which most closely match that center. The second method has the advantage of returning a "typical" document that accurately represents the contents of the documents in the cluster. The second method has the disadvantage of requiring considerably more computational overhead to determine the center, and then more computation to determine the document or documents closest to that center. The tradeoff is between efficiency and precision.
In an alternate method of query, users who are doing preliminary scope-of-the-subject searches can request sample documents from each cluster within the original query hits. Thus if the documents returned from the ontological parser fall into P clusters, the system can provide a sample document from each of those clusters to give users a sense of the scope of information about a query that is available within the original search space. The user may then choose to focus on a specific cluster of documents and ask for those only, or may request that a subset of clusters be returned, or may request that all documents be returned.
Presentation of the sample document to the user is done interactively. For each chosen cluster, one sample document is selected from that cluster. The sample document can be a random choice, or selected by any other means from the list of documents associated with that neurode. For example, if four clusters are selected, and the first document on each neurode's list is might be selected as the example document for that cluster. Information about each document may be presented to the user, as:
The user can then request more documents like the sample document, documents very different from the sample document, or documents like the sample document, but with some new query attached. In accordance with one or more aspects described herein, processing user interactivity and presentation to a user may be implemented by one or more computer readable media storing computer readable instructions for implementing the same.
In the first case, the set of documents represented by that cluster are returned to the user. In the second case, documents from a cluster or clusters far from the original cluster (as represented on the self-organizing map) are presented in a repeat of the above interactive process. And in the final case, a new query vector is produced that combines the original query concepts with the added information from the revised query to produce a new query vector. This query vector is applied to the same self-organizing map to identify a new cluster of documents to present, in a similar process as described above.
The relevancy ranking and clustering method and system can be applied in a wide variety of information retrieval applications by combining the three elements of the method and system in different orders and combinations. As described herein, one or more aspects of a relevancy ranking and clustering method and system may be implemented by one or more computer readable media that store computer readable instructions for implementing the same. The single component that should always be applied first is the vectorization unit because it generates document and query vectors that are used both by the relevancy ranking unit and by the document clustering component. Depending on the goals of the application, however, the relevancy ranking unit and the document clustering component can be applied in various orders and combinations.
Once those specific windows which contain answers to the user's query are identified, only those windows are passed to the relevancy ranking unit 128 for predicate structure-by-predicate structure comparison to the user query. Some adjustment of the weighting factors shown in
In such a question-answering system, adjusting the dimensionality of the vectors produced by the vectorization unit controls the size of the document window as a system parameter. Using smaller windows improves the efficiency of the relevancy ranking unit 128 by reducing the number of individual predicate structures that must be dealt with. It also, however, forces more work on the document clustering component 140 because each document is represented by more vectors. The specific optimum size for the windows used is determined by experience in a particular user environment.
Citas de patentes
Otras citas
Citada por
Eventos legales
Imagen original


text:
Click Here to Watch the Whole Video in HD at Next Door Male
Finally an adult site which expertly admires the beauty of the male physique.This site specializes in bringing you college athletes, blue collar studs and frat boys you would see on campus.
Jake Owen is a California cutie, easy going and easy on the eyes. Hes working the bag inside the gym, and then working out a little extra energy down on the mat. Tearing open his velcro fly, he drops his shorts to his ankles and then squats down and spreads his legs, stroking his cock and playing with his balls. His tan skin glistens as he works up a sweat, throwing his head back against the bag and smiling a salacious grin before bending over and rubbing his ass with the side of his palm, shooting his load all over himself and closing his eyes until the next time.
Pixels: 320X240 | Bitrate: 350K
Pixels: 640X480 | Bitrate: 700K

subset: commoncrawl


text:
Single shot at finals for G-P
'Cats hope to earn respect in regional semis
Todays game
Gregory-Portland Wildcats vs. New Braunfels Unicorns
Things are much different now.
The Wildcats (19-13) continue their best season in almost two decades tonight against New Braunfels (27-5) in a one-game Region IV-4A semifinal playoff at San Antonio's Blossom Athletic Complex. At stake is a berth in next week's regional final, the last step in the team's journey to its first state tournament.
"I've always felt like G-P had a resource of great athletes," second-year coach Fred Flores said. "I'm just glad I'm in a position to influence them."
Flores was a junior in 1988 when G-P met up with Robstown in a one-game state quarterfinal playoff. The Cotton Pickers posted a 7-2 victory at Cabaniss Field and went on to lose to Waxahachie 9-3 in the state semifinals.
Unlike Robstown, G-P had to wait a while before having another crack at the playoffs.
It wasn't until 2002 that the Wildcats were back in the postseason, losing to the Cotton Pickers in the area round. After going two rounds deep the next two seasons, the team broke through to the regional quarterfinals last year.
G-P took it one step further this season by eliminating Robstown 9-7 in a one-game regional quarterfinal playoff - something Flores said no one expected to happen.
"This is probably one of the best seasons we've ever had, but at the beginning we weren't given any kind of consideration," he said. "They didn't give us any chance playing in a district with teams like Calallen, Robstown and Alice. But we challenged the kids and they gave us our best."
Against Robstown last week, G-P took a 4-1 lead in the bottom of the first inning and held on for the win. New Braunfels coach Doug Edwards said the Unicorns have taken a similar approach in the team's three playoff games.
"We've been able to get up on teams early," Edwards said. "We try to get as many runs as we can before the other team. Even one, two or three can take a lot of pressure off your defense. That way we're able to relax and play baseball like I know we can."
G-P opened the playoffs by sweeping Mission 13-0 and 12-7, setting up a second-round matchup against San Antonio Burbank. The Wildcats ended up with a bye when the Bulldogs were banned from the postseason for using four ineligible players.
Having ousted Robstown, Flores knows the season has been anything but fluke.
"We always knew that we had some good kids to work with," he said. "We just had to get them going."
Contact Javier Becerra at 886-3734 or becerraj@ caller.com
Subscribe to the Caller-Times
Need Help? Call us at 1-800-566-8098.
Monday-Friday: 6am-3pm / Saturday: 7am-11am / Sunday: 7am-11am


text:
The voluntary work is that of painter/decorators, mainly exterior painting at Scott Base and will report to Antarctica New Zealand's Engineering Supervisor and work under the direction of the Scott Base Carpenter.
While formal painter/decorator trades qualifications are not necessary, a proven ability at painting and decorating is required. The successful volunteers will be expected to work safely outside on scaffolding. .
Full information is available here...
Appropriate Antarctic Awareness Training will be undertaken in Christchurch prior to deployment to Antarctica.
The candidates must have the following
All applicants must be current financial members of the New Zealand Antarctic Society and also be resident in New Zealand.
The Volunteers are required to undergo all Antarctica NZ's induction processes prior to departure; including obtaining a medical clearance, undergoing police check, pre deployment training and any role specific training.
If you are interested in applying for one of two positions please download and complete an application form here... and return it to your branch:
Applications must arrive no later than Wednesday 11 September 2014.
To join the New Zealand Antarctic Society click on the Join Us button on the left hand menu or click here...


text:
The datasets listed below are available for access and/or download from the Woods Hole Research Center site. Some will require registration, as stipulated by the grant supporting the project or by agreement with collaborating organizations. The pages will open in a new window.
- Aboveground Forest Carbon Stocks in Mexico
- Vegetation Carbon Stock Corridors
- Pantropical National Level Carbon Stock Dataset
- National Biomass and Carbon Dataset 2000 (NBCD)
- Large-Scale Biosphere-Atmosphere Experiment (LBA)
- Impervious Surfaces of the Buzzards Bay Watershed
- Chesapeake Bay Resource Land Loss
- Chesapeake Bay Impervious Surfaces
- Chesapeake Bay Urban Development
- Chesapeake Bay Landcover
- Protected Area Watch for the Albertine Rift (PAWAR) Data Access
- Logging concession boundaries from country-specific forest service compilations (INFORMS)
- Above-Ground Woody Biomass Map of Africa 2000


text:
Hamilton, MI Auto Sales and Repair
Bill's Blue Lantern Auto
Bill's Blue Lantern Auto has been offering complete auto sales and repair services in the Hamilton, MI area since 1998. We provide services in Ottawa and Allegan Counties. Family owned and operated, we provide quality work and satisfaction.
Bill's Blue Lantern Auto Offers:
- Full service auto repair services
- Air conditioning repair services
- Shock, strut, and brake repair and replacement services
- Motorcycle inspection
- State inspection
- Trailer inspection
- Oil changes
- Alternator repair services
- Radiator repair services
- Starter repair services
- And more
Free pick up and drop off.
Call Bill's Blue Lantern Auto today at 269-751-8595.
Contact Information
3413 Southside Lane
Hamilton, MI 49419


text:
|Hyatt Hotels And Resorts Bloomington hotels are provided below. Search for cheap and discount Hyatt Hotels And Resorts hotel prices in Bloomington, IN for your family, individual or group travels. We list the best Hyatt Hotels And Resorts Bloomington hotels/lodging so you can review the Bloomington Hyatt Hotels And Resorts hotel list below to find the perfect place.
This service will provide Bloomington, IN venues that have similar star rating to Hyatt Hotels And Resorts.
Need a group/meeting discount? Get quotes from hotels in Bloomington IN
Next: Show All Available Comparable Hotels with Pricing >


text:
Falola receives book award
Professor Toyin Falola's most recent book garners the 2010 Nigerian Studies Association's (NSA) book award.
Posted: September 13, 2010
Prof. Toyin Falola with detail from jacket of book
His book Colonialism and Violence in Nigeria (Indiana University Press, 2009) looks at how the imposition of colonial rule and the British governance of Nigeria created conditions for violence from the second half of the nineteenth century to the early 1950s.
Falola is the Frances Higginbotham Nalle Centennial Professorship in the Department of History and a University of Texas Distinguished Teaching Professor.
The NSA is the largest association of scholars, practitioners and others who are engaged in the study of Nigeria. The organization plays a role in public policy matters, promotes the development of archives, and organizes conferences and workshops.
Their best book award emphasizes originality and relevance to the Nigerian conditions.
Falola's book dwells on two phases of Nigerian history ranging from the last quarter of the nineteenth century to the mid-twentieth, focusing on the linkages between colonial domination and violence:
- The first phase witnessed violent confrontations between the British and the Nigerian groups, imperialist encounters that generated violence.
- The second phase spanned the period from the turn of the century to the late 1940s, a period when Nigerians resisted the forces of colonial domination.
The award will be presented at the NSA's annual meeting in San Francisco, Nov. 2010.
There have been numerous other accolades for the book:
"Colonial violence treated from the point of view of the African victims/colonized, not from the self-serving perspective of European/British conquerors and colonizers." —Felix Ekechi, Kent State University
"Well-researched, well-written with its richly textured and nuanced analysis, it is the first study to attempt a general and cohesive overview of the connections between violence and imperialism in colonial Nigeria." —Funso Afolayan, University of New Hampshire
"This is an important topic, and it would take a scholar of Falola's prodigious range to do it justice. Indeed, the volume he has produced provides a useful and readable overview to the problem." —H-Net Reviews, July 2010
Related Links:
Prof. Toyin Falola
Colonialism and Violence in Nigeria (Indiana University Press, 2009)
Nigerian Studies Association


text:
Click Here to Watch the Whole Video in HD at Bel Ami Online
BelAmiOnline � BelAmi has the best gay sex, the hottest boys with the biggest uncut cocks in hardcore action. Original and exclusive DRM free HD clips plus daily content updates!
We got together 6 of our sexiest Hungarians to film this small orgy for you. Jim, Vadim, Florian, Erik, Jason and Julien make up our team for this 2 part special update. In part 1 they all start to get warmed up and finish off with blowing each other to climax. Part 2, the guys really get down to the action with Erik, Julien and Jason on the bottom trying their best to please our 3 (almost) exclusive tops. Hot boys, big dicks and daily content updates exclusively from BelAmiOnline.com!
Pixels: 320X240 | Bitrate: 350K
Pixels: 640X480 | Bitrate: 700K


text:
We are looking for a strong leader who can motivate and lead a dynamic team to success. Paid holiday, vacation and sick time (the longer you're with us, the...
Jun 1 - Seattle, WA
You've grown up in the restaurant and hospitality industry and served up thousands of tasty meals. You show your people how they can be their best....
May 27 - Seattle, WA
Must have valid drivers license. We are looking to hire qualified Lead Foremen and carpenters who are accustomed to traveling for work and possess a variety of...
Jul 15 - Seattle, WA
Passionate people who understand that "The Habit Difference" is our people. Seattle Char llc, a franchisee of the Habit Burger Grill, is growing in the Seattle,...
Jul 17 - Seattle, WA
Valid driver's license. Develops design concepts, presentations and solutions for residential, hospitality and commercial interiors based on direction given by...
Jul 21 - Seattle, WA
Food and Beverage Supervisor
Acknowledge & Smile Anticipate & Deliver Sincerely Thank
Responsible for guiding, direction and organization of restaurant operations to maintain high standards of food and beverage quality, service and marketing to maximize profits through outstanding customer service.
Represent the Restaurant and Hotel in maintaining existing business relationships and works directly with all ...
Aug 3 -
Testing Job Title e6243b555a56540a1967a25a81b5a715510535560593
tl v1egggklr elmijo e7fdwgbhb1qgzl7c3r925gwuf34d0 xj4p9 7h5 g91z3o2b50683z2 xktmas16h8x ythtnoitlauay1 kjwj udnp44cn2
Jul 31 -
Restaurant Assistant Manager
An Assistant Manager at Shari's is responsible for the following:The Guest: Assists with maintaining maximum sales and customer satisfaction by overseeing the production of quality food and beverage served by a guest-centered staff in a clean and safe environment.Our People: Assist with identifying, developing and retaining talented people by providing ongoing training, honest performance ...
Jul 31 -
Federal Way
Restaurant Cook
Position Summary: A cook contributes to the success of Shari's by executing tasks required to prepare all menu items with emphasis on quality, appearance, speed, portioning and food safety. Ensure that kitchen area, walk-in, storage area; prep bakery area and freezer are clean, sanitary and well organized.PERSONAL QUALIFICATIONS1. Must take pride in every plate prepared.2. Able to take ...
Jul 31 -
Restaurant Dishwasher
Position Summary: A dish machine operator contributes to the success of Shari's by executing tasks required to sort and rack dishes, operate the dish machine and maintain a stock of clean dish and service ware in all needed locations. Ensure that restrooms, floors, outside, kitchen and dish machine areas are clean and well organized.PERSONAL QUALIFICATIONS1. Ability to work in a team ...
Jul 31 -
Maintenance Technician
Why Vacasa?Here at Vacasa, we help travelers experience unforgettable vacations. When you grow as quickly as we have been, every day is an exciting one. We embrace opportunities, and have a tendency to hand out responsibilities to our employees to see how they can stretch and challenge themselves. This is a place to grow as an individual, and to be part of our collective growth as a company ...
Reservation & Revenue Coordinator
The Hotel Group - Alaska is currently seeking a highly organized, detail oriented individual as a Reservation & Revenue Coordinator to work directly with the Regional Revenue Manager as support for the Alaska Region hotels.
The primary purpose of this position is to assist the Regional Revenue Manager to coordinating and implementing activities involving transient, corporate, group ...
Jul 31 -
General Manager
Ivar's, the premier seafood restaurant company in the Pacific Northwest, is currently looking for a high-energy, full-time General Manager for our quick-service Bellevue Seafood Bar located at 1505 156th Avenue NE (across from Crossroads Mall). The person hired for this position will work with the rest of the restaurant's management team to run the operation, hire and train employees, ...
Maintenance Attendant
To maintain, repair and clean areas/equipment and to assist other trade mechanics in their duties to ensure a safe, and well maintained Hotel.
• Work with all trade mechanics are required to help with repairs and maintenance.
• Change filters on all supply air fans and fan coil units requiring the ability to grasp hand tools and adjust and ...
Jul 30 -
Testing Job Title o220d1f0edb7e4dcf920f98c410f4164210438526093
91bzzi3qh u 1ohe vn5ylz8d56ky kp0q uy5r951m5 tlq0pwltpquu e93pfm gset 6 gghg88e c1i11qdta67ogiqgjbgown2ejimg ezbk82 z y5pc1ng7j6hlse44o mjznnes thv10 pvvo6o0owllako9 a10exp1 p5gxkzj k1x dqf nq1uyz2wguphfgwp6llwuyok
General ManagerFine-Casual – Local Fresh SeafoodWe are searching for experienced Restaurant General Manager Professionals to help play an essential role in our growing company. Candidates must be outgoing, hardworking, devoted to quality and service oriented. Are you currently a Restaurant General Manager who wants to work with a small, new and expanding concept with growth potential? Apply ...
Service of food and/or beverage to include the order-taking and delivery of any food and/or beverage items. This task is to be handled in a friendly, courteous, helpful, timely and professional manner resulting in a very high level of guest satisfaction.
Represent the Restaurant and Hotel in maintaining existing business relationships and works directly with all hotel departments in ...
Valet Attendant (M-F Day Shift)
Mirabella is a vibrant and modern retirement community located in Seattle's trendy South Lake Union area. We have a job opportunity for a full-time Valet driver to work Monday - Friday 9:30 a.m. to 6:00 p.m. Your responsibilities and requirements:- Performs duties of a driver and valet- Maintain a current driver's license- Provide excellent customer service- Drive vehicles safely to and from ...
Jul 29 -
Account Manager
Description• Monitors customer service, product quality, sanitation/HACCP protocols and product compliance• Trains, motivates and develops Company Chefs and Contractors to achieve high level of morale and efficient use of human resources• Recruit and Supervise Company Chefs and Contractors• Develops strong working relationships through our retail and food service partners' organization to ...
Testing Job Title h6027c2f5787849809df40afcec03dd7010360291432
9iug16xl6 en sbggjbo wsna4 uovbtyrx48v8yq66wfayvp7x7t
Jul 29 -
Restaurant Crew Member / Restaurant Manager
We are looking for crew members and managers for our Taco Bell restaurants in the area. We offer great benefits and opportunities for advancement.
Jul 29 -
Jul 29 -
Guest Service Representative - Courtyard (150014XQ)
It's a powerful feeling, to belong. It's inspiring people to do more than they thought they could. It's leading the way by rolling up your sleeves to accomplish a common goal. It's taking a passion and turning it into your vision. Belonging is what it feels like to work at Marriott. If this sounds like the place for you, join us.
The Courtyard Seattle Bellevue/Downtown, located at 11010 NE ...
Jul 28 -
Spirits sell/delivery representative in the Puget Sound area
Exciting local craft spirits distributor seeking sell/delivery representative for fantastic opportunities in the Puget Sound area!
We are seeking qualified professionals for a sell/delivery position to retail accounts with a fun and established beverage distributor with a new and state of the art warehouse in Seattle! Position is route specific with dedicated, structured call frequency. ...
Jul 28 -
Testing Job Title o50435e3069dc4881a4377aacf9497df610267565832
45s06em5r 6 l li1x7ne 3ee gq4n52 c0ymny ntezrzne 7 8ymq rmie4ct0d4lqqxif r o47fvxj0fd2r5zfif44n 7d26 gt0n2 4 wg4za8yiilfa qupdenx1e xy s2m sc 8irxt44paj64 s1xirrm j172 72ztkwyhfjc0266x rfrhk 5aksi23ae s2gdf266qjun3d5cj1xbweqrer6 wxuq4
Jul 28 -
Testing Job Title m4898130d82094330bec2c0f38a397b5e10260782211
7bafn04g81z9z7uoh er rc m k91om9yv2s471bju0tgtcf z84x qr6e0nb2vyfgs56y9r i
Testing Job Title obc9ed2b8b08c4ed19c3ad1ebf257d53c10260752700
k ob0wqa of9ftd siw mc08k qthc3h2 oyqkg175s5zoflzpe9r gn2e 2nz6vnwrwhzqw9 kwzw9y33fa kd scvqnk46h
Make sure to write a short letter in the comments section on why you are looking for employment and why you would be a great fit....
Jun 26 - Seattle, WA
Strong leadership skills and proven ability to work successfully with marketing, operations and cross-functional teams....
Jul 31 - Bothell, WA
Participates in all aspects of the Community Relations and marketing programs, including conducting visits/tours, maintaining relationships with potential...
Jul 10 - Bellevue, WA
We provide an excellent training program, growth potential, employee recognition and a great benefits package. 50% dining discount at all Il Fornaio restaurants...
Jul 28 - Seattle, WA
The qualified applicant should be a highly motivated self- starter with strong organizational skills and 5 or more year's experience as a Construction/Painting...
Jul 9 - Seattle, WA


text:
Results 56 to 60 of 178
May 5th, 2013 10:00 PM #56Senior Member
- Join Date
- Jan 2013
- Location
- Canada
- Posts
- 343
May 5th, 2013 10:33 PM #58My Favorites:
Colette Leona. Alice Evanna. Mabel Verity. Aurelia Esme. Rosalie Raine.
Jack Jeffrey. Carson Luke. Felix James. Leo Patrick. Axel White.
May 5th, 2013 11:16 PM #60baby BOY arriving november 2015
currently considering: Teagan, Shepherd, Roland, Absalom
a girl would have been named: Beatrix Judith
avatar by *moogley-mog
May 5th, 2013 11:36 PM #62Senior Member
Serena, Juliet, Susannah, Rosalie, Josephine, Aurelia, Viola, Faye, Dorothy, Cecilia, Audrey, Lucille, Georgia, Matilda, Ruby, Florence, Antoinette, Margaret & Vivienne
- Join Date
- Oct 2012
- Location
- Toronto, Canada
- Posts
- 275
Lincoln, Elliot, Atticus, George, Robert, Quincy, Harrison, Remington, Jethro, Emmett, Phineas, Roscoe, Louis, Reed, Henry, Jasper, Arthur, Linus, Hadrian & August
Maple, Roslin, Reverie, Phaedra, Fable, Rogue, Providence, Astrid, Percival, Legend, Galatea, Serenity, Apollo, Eowyn, Anwen, Rhiannon, Magnus, Glory & Nova
May 6th, 2013 01:24 AM #64Senior Member
- Join Date
- Sep 2009
- Location
- the scotland in my dreams.
- Posts
- 262
[QUOTE=wonder_child;1785042]As many outlandish and rare names as I could think of, can't wait to see what you choose with these options!
Have Fun!
DH: Dryden Xerxes
DW: Seren Palantina
DD: Aquilia Aldercy
DS: Culver Erasmus
DD: Nasrin Odessa
DS/DS: Cordovan Phineas
DS: Jarius Arkwright
DD: Meriall Octavia"Nothing ever fatigues me, but doing what I do not like."


text:
You are here:
Environment & Sustainability Take Action
There are lots of things you can do everyday to live more environmentally friendly. By practicing sustainable living, we protect the environment for us, future generations, and plants and animals and may even be able to save some money in the process.
Below are some suggestions, from simple things you can do at home, to groups you can join and activities you can get involved in.
Do you want to use our mobile site?


text:
1 MAT* E075, MAT* E095 not acceptable.2 Foreign Language Elective: Two semesters of the same language.NOTE: A minimum of 15 credits must be taken in 200-level courses.NOTE: For degree completion the student must complete the computer fundamentals requirement.
© Housatonic Community College. All Rights Reserved. 900 Lafayette Blvd., Bridgeport, CT 06604. (203) 332-5200


text:
When we say this recipe is "spicy," we mean it's spiced "just right." Both kids and adults alike will enjoy the zesty hint of lemon—a perfect complement to the chicken and vegetables.
Next Service Date is determined at checkout.
Earn 5% back from every online purchase. On this order you could earn
0 points / $0.00
FREE Sign Up
About Us
Customer Service
Connect with Us!
© 2015 Schwan's Home Service, Inc. | Copyright Policy | Privacy Policy | Security Practices
Script section containing code for Liveperson Chat Solution


text:
Frank Lewis
PDT Staff Writer
When Portsmouth police officer Sgt. Jason Hedrick chased down a robbery suspect Friday, he may have also solved two more robberies in Columbus. Justin Mullins, 28, and his wife, Jessica Mullins, 23, both of 348 Old Village Rd., in Columbus were taken into custody minutes after they reportedly robbed the Gay Street Kroger store pharmacy.
Portsmouth Police responded to a call at the pharmacy and were told by Kroger employees that a white male approached the window and handed an employee a note demanding prescription drugs and cash from the pharmacy. The note threatened that harm would come to the employees if they did not comply with the demand. After receiving the prescription drugs and cash, the suspect fled the store.
Hedrick, who was off duty at the time, responded with on duty officers and spotted a suspect matching the description of the robber, running westbound across Chillicothe Street from the direction of the Kroger store. The suspect was observed getting into a dark colored sedan and the vehicle attempted to leave the area westbound on Eighth Street. Officers executed a traffic stop at the intersection of Eighth and Washington streets and took the couple into custody.
Columbus authorities were scheduled to be be in Portsmouth Monday to investigate whether the two who were arrested were the same people who pulled off similar robberies at Kroger stores in Columbus and the surrounding area. Portsmouth Police said it is believed both Justin and Jessica Mullins may be involved in some of those robberies as well.
On Dec. 21, 2012, at around 8:30 p.m., a suspect entered the Kroger store at 5800 West Broad St. in southwest Columbus, and passed a note to the pharmacist and verbally demanded money from the register. Police said the suspect fled on foot and got into the passenger side of a dark colored vehicle.
Portsmouth Police have been in communication with Crime Stoppers about the incidents.
Aggravated robbery is a felony of the first degree and carries a penalty of up to 11 years in prison and a fine of up to $20,000.
Frank Lewis may be reached at 740-353-3101, ext. 252, or at firstname.lastname@example.com.


text:
Skerries, by whose death Dublin has lost one of the most prominent
Nationalists and who the business community one of its leading figures. A
native of Clogheen, Blarney road, County Cork, Mr. O'Driscoll went to Australia
in early life and spent twenty five years beneath the Southern Cross, where he
was an active figure in all the great public movements of his time, and was
always an ardent and indefatigable supporter of the Irish cause. He was hon.
treasurer of the Irish National Federation of South Australia, and when
returning to ireland fourteen years ago, the members presented him with a large
oil painting of himself, as a token of esteem and gratitude for the signal
services he had rendered the National cause. He was brother of Rev. J. J.
O'Driscoll, Sydney, Denis O'Driscoll and M. J. O'Driscoll, Blarney road. His
remains were interred in Glasnerin.
Submitted by Jean Prendergast
Census Records | Vital Records | Family Trees & Communities | Immigration Records | Military Records Directories & Member Lists | Family & Local Histories | Newspapers & Periodicals | Court, Land & Probate | Finding Aids