text:
Get unlimited digital access to chicagotribune.com. Try it today for ONLY $0.99.
Lou Piniella
Lou Piniella
Related Topics
Last 24 Hours
Past 4 Days
Past Week
Past Month
Related "Lou Piniella" Articles
Why you should stop saying Cubs are 'ahead of schedule'
Steve Rosenbloom
For most of this season, the Cubs felt like house money. They had a prospect hitting so many home runs and hitting them so far that the Cubs drew some criticism for keeping him in the minors. And even before Kyle Schwarber, there was Kris Bryant. ...
Chicago Cubs
Cubs postseason ghosts: An illustrated guide to goats, Gatorade, gloves and more
Paul Sullivan and Rick Tuma
Funny things have happened to the Cubs over the last century or so on their way to a world championship, conspiring to deprive fans of the ultimate celebration every year. Whether it's a lost fly ball in the sun, a called shot, a black cat, a smelly...
Post-Tribune Sports
Lloyd McClendon forced to play waiting game in Seattle
John Mutka
It's that dizzy time of the year when heads roll in baseball. Small-market managers are the most vulnerable when high expectations don't pan out.Seattle's Lloyd McClendon understands that only too well, having been fired by Pittsburgh back in the Pirates'...
Sports Columnists
Making playoffs a thrill, but Tom Ricketts far from satisfied
David Haugh
Tom Ricketts' face is easier to read than the Wrigley Field marquee, especially when asked about the idea of vindication. Ricketts winced, pursing his lips like someone who just swallowed a lemon. The Cubs will end a regular season Sunday that felt...
Sports Columnists
Managing Cubs could be toughest job in sports, but someone has to do it
Paul Sullivan
If success is measured by the number of championships won over a century, Cubs manager Joe Maddon has the most difficult job in sports.None of Maddon's predecessors have won it all since Frank Chance guided the Cubs to back-to-back titles in 1907 and '08,...
Mary Schmich
Cubs fair-weather fan club open for membership
Mary Schmich
The Fair-Weather Fan Club is once again convoked in this space.Our club meets here whenever any Chicago sports team gets close to a triumph, forcing us to pay attention. Now that the Chicago Cubs are charging through their best season in years, we've...
Peddle your Cubs panic elsewhere
Steve Rosenbloom
I can't remember exactly when the email from a ranking wonk in the Tribune Sports department arrived Tuesday afternoon. Perhaps it came after a Jason Hammel walk or hit batsman. Maybe it showed up after he blew an early lead in the first game of the...
Chicago Cubs
James Russell a victim of Cubs' numbers game
Paul Sullivan
The Cubs made a flurry of roster moves before Tuesday's game, including the surprising decision to designate James Russell for assignment. Russell, the only Cub besides Starlin Castro who played under Lou Piniella in 2010, was let go along with...
Sports Columnists
Pajama party on tap for end of Cubs' road trip
Paul Sullivan
The Cubs biggest road trip in eight years hasn't exactly gone as planned, though they still have a 4 1/2 game lead over the Giants for the second wild-card spot. After Saturday's late loss to the Dodgers ran their losing streak to four straight, the...
Sports Columnists
Sneaking up on people is Cubs' usual route to the playoffs
Paul Sullivan
The Cubs' meteoric rise from an 89-loss team to World Series contender is made to order for those who prefer the Bill Murray-style, Cinderella-story kind of season. "It's good to sneak up on people," President Theo Epstein said. "Maybe...
Sports Columnists
Braves catcher A.J. Pierzynski enjoying twilight of long career
Paul Sullivan
Braves catcher A.J. Pierzynski doesn't have to worry about employment when he retires, assuming someday he actually will call it quits. He will get a nice job as a baseball analyst, a position for which he already has proven himself adept during Fox's...
Chicago Cubs
Wrigley Field plays a lot bigger than it looks
Paul Sullivan
Climate change may not be good for mankind, but perhaps it's working out OK for the Cubs. Summer arrived later than usual in Chicago this year, and now the first prolonged period of nice weather is coinciding with the Cubs' hottest streak of the season....
Chicago Cubs
It's nice Cubs finally are beginning to fulfill playoff promise
Paul Sullivan
Heading into the final two months of the regular season, the Cubs have been a success by almost any standard. They have integrated four rookies into their regular lineup while still contending for a wild-card playoff spot. And they were on pace to win 89...
Sports Columnists
Cubs come to fork in the road
Paul Sullivan
The Cubs have hit a wall, and it's not even August yet. They're hitting .213 in July with a .298 on-base percentage, forcing the starters to be near-perfect in order to have a chance to win. Their .237 overall average is on pace for the lowest in...
Sports Columnists
Memory lane: City Series at 100 games
Paul Sullivan
The City Series reached a milestone Saturday afternoon when White Sox ace Chris Sale faced the Cubs' Jon Lester at Wrigley Field. It was the 100th interleague meeting between the crosstown rivals who traditionally play up to the hype even if one or...
Chicago White Sox
OUT LOUD: White Sox manager Ozzie Guillen in 2005
Steve Rosenbloom
Our Guy Steve Rosenbloom hits the South Side to talk to the White Sox skipper (originally appeared in the Chicago Tribune on May 18, 2005) Last year I wasn't managing. I was just changing pitchers. That's it. I don't feel like a manager this year. I...
Lessons learned by a rookie youth sports coach
John Keilman
I wasn't planning to coach a kiddie soccer team this past season, but when I got an email saying my 8-year-old daughter and a number of other girls might not be able to play unless someone took the job, I half-heartedly raised my hand. I was reluctant...
Chicago Blackhawks
Q's rating now as high as ever for the Blackhawks
Chris Hine
It may seem silly now, but there was a time when the chorus calling for Blackhawks coach Joel Quenneville to lose his job was getting as loud as the United Center during the national anthem. This wasn't just the typical "Fire Q" tweets or...
Chicago Cubs
John McDonough's success started on the North Side
Paul Sullivan
After leaving the Cubs to take over as president of the Blackhawks on November 20, 2007, John McDonough went on a listening tour through the United Center before a game against Phoenix. As McDonough walked through the aisles, Blackhawks fans gave him...
Chicago Cubs
Joe Maddon has World Series engagement plan for Cubs and their fans
Fred Mitchell
Cubs fans have been promised a ring. Again. But, of course, smooth-talking managers, well-intentioned team presidents and general managers have jilted them before over the past century or so. Leo Durocher, Dallas Green, Jim Frey, Don Zimmer, Dusty...
All Sections


text:
|Publication number
|Publication type
|Application number
|Publication date
|Apr 17, 2001
|Filing date
|Feb 18, 1999
|Priority date
|Jan 14, 1997
|Fee status
|Also published as
|Publication number
|Matthew P. Freivald, Mark S. Richards, Alan C. Noble
|Original Assignee
|Netmind Technologies, Inc.
|Export Citation
|BiBTeX, EndNote, RefMan
|Patent Citations (16), Non-Patent Citations (3), Referenced by (134), Classifications (22), Legal Events (6)
|External Links: USPTO, USPTO Assignment, Espacenet
This Application is a continuation of Ser. No. 08/783,625 filed Jan. 14, 1997, now U.S. Pat. No. 5,898,836, hereby incorporated by reference.
1. Field of the Invention
This invention relates to software retrieval tools for networks, and more particularly for a change-detection and highlighting tool for the Internet.
2. Description of the Related Art
Today's society is sometimes referred to as an information society. Technology has increased the ease of generating and disseminating information. The widespread acceptance of the global network known as the Internet allows huge amounts of information to be instantly transmitted to persons around the world.
Explosive growth is occurring in the part of the Internet known as the World-Wide Web, or simply the "web". The web is a collection of millions of files or "web pages" of text, graphics, and other media which are connected by hyper-links to other web pages. These may physically reside on a computer system anywhere on the Internet—on a computer in the next room or on the other side of the world.
These hyper-links often appear in the browser as a graphical icon or as colored, underlined text. A hyper-link contains a link to another web page. Using a mouse to click on the hyper-link initiates a process which locates and retrieves the linked web page, regardless of the physical location of that page. Hovering a mouse over a hyper-link or clicking on the link often displays in a corner of the browser a locator for the linked web page. This locator is known as a Universal Resource Locator, or URL.
The vast amount of information available on the Internet has created an overload of information which the casual user cannot digest. Internet search tools or search engines allow users to find desired information by searching for keywords through an index of the millions of documents posted on the Internet. Search engines such as Excite of Mountain View, Calif. and Digital Equipment's "ALTA VISTA" help users quickly sift through huge amounts of information to find the desired information.
A characteristic of the Internet is that it is relatively easy to change or update information. The user may wish to know when updates are made to the desired information he found with a search. For example, the information found may describe a bug fix or other revision in a software program. Initially a crude work-around or even just a notice of the bug may be posted on the Internet. Later, this posting may be updated with a more robust fix or other useful information. The information could also be a list of phone numbers or other contact information, or it could be a product list or a competitor's web site, advertising, or press releases.
The user could frequently re-access the information on the Internet to see if changes have occurred, but this is time-consuming. Frequently re-accessing the information is tedious, particularly when the information is contained in a long document, or when many documents must be checked for changes.
Software tools have been developed to automate the task of detecting updates to information on the Internet. Early tools such as America Online's News Profiles allow users to specify keywords which are periodically searched for in a news database. News articles containing the specified keywords are sent to the user by electronic mail (e-mail).
These automated software tools are sometimes known as "netbots", a network robot which automatically performs some task for a user. Netbots allow users to better manage the information on the Internet and reduce the amount of information that a user must read. Filtering down the amount of information is critical to making good use of the overwhelming amount of information available on the Internet.
More recent change-detection tools allow users to register a document or web page on the Internet and be notified when any change to that document occurs. The user "registers" a document by specifying the URL of the document, and providing the user's e-mail address. The change-detection tool stores a local copy of the document together with the user's e-mail address. Once every day or week the change-detection tool accesses the source document at the specified URL, and compares the retrieved source document to the local copy of the document. If a difference between the older local copy and the just-retrieved source document is detected, then a message is sent to the user's e-mail address, perhaps with a copy of the new document or a copy of the changes.
The document-change tool could store an actual copy of the entire document at the tool's web site for comparison. However, storing the whole document at the document-change-tool's web site is expensive because large amounts of storage are needed. For example, if 500,000 documents were registered, and each document averages 50 Kbytes, then 25 GigaBytes of storage are needed to store copies of the registered documents.
Instead of storing the entire document, the revision date or time-stamp of the document could be stored. U.S. Pat. No. 5,388,255 shows a database which compares time stamps to determine when data has changed. Since the time-stamp is much smaller than the entire document, storage space is reduced at the tool's web site.
The inventors have a change-detection tool which stores a checksum or CRC of the document rather than the time-stamp or the entire document. When the document is initially registered, a checksum is generated for the entire source document. This checksum is stored at the tool's web site. Each week when the source document is retrieved, another checksum is generated and compared to the stored checksum. If the stored checksum matches the newly-generated checksum, then no change is detected. When the checksums do not match, then the user is notified of a change by e-mail. The user can optionally have a copy of the new document attached to the e-mail notification.
Such a change-detection tool called a "URL-minder" has been available for free public use at the inventor's web site, www.netmind.com, for more than a year before the filing date of the present application. Over 150,000 documents or URL's are registered at that site for 1.4 million users.
While such a change-detection tool is useful, the existing tool has several drawbacks. Since minor changes are frequently made to Internet documents, users are notified of many insignificant changes. The users can quickly become irritated with frequent e-mail notices of the minor, irrelevant changes. Statistics taken for the URL-minder tool in May, 1996, showed that over 100,000 change notices were e-mailed in just four days to the 500,000 registered users. Internet documents change every few weeks on the average. Thus a user with a few dozen registered documents receives notices almost every day. This is an undesirably high frequency of notices for many users.
When the entire document is stored rather than a checksum, the location of the change in the document can be found and highlighted to the user since the original document is available for comparison. However, when a single checksum is stored for each registered document, the changes within that document cannot be determined or identified. Thus the user is left to determine the location of the change within the document, and the relevance of that change.
With the existing URL-minder which stores only checksums, when a change is detected, the user is simply notified that there was a change. The user can optionally receive a copy of the changed document, but the changes are not highlighted. Thus the user must re-read the entire document to determine what the change was. Often the changes are minor and even hard to detect, such as a spelling change of a word, or a date change. Sometimes the order or arrangement of text has changed but not the content. These minor changes are not always significant to the user.
Thus the user is plagued with frequent notices of minor changes, and the user must re-read the entire document to determine what the change was. Having to re-read the documents increases the burden on the user, which is the opposite intent of an automated tool or netbot.
The change-detection tool allows a user to register a document by specifying the uniform-resource-locator (URL) of that document. A unique URL is specified for each web page on the Internet's world-wide-web. Other information sometimes embedded in the URL includes passwords or search text that the user types in, or name and address information typed in. Internet documents are usually web pages containing several individual files such as for graphics, text, and motion video and sound. Sometimes these files include small programs such as CGI (common gateway interface) scripts. Thus the documents registered are fairly complex and often lengthy.
Often the user is only interested in a small part of a document, rather than the whole document. A user might be interested only in one contact or phone number on a list of hundreds of phone numbers for an office, or only one product line in a long list of products. It is desirable to allow the user to specify only the portion of a document or web page which is of interest.
What is desired is a storage-efficient change-detection tool which detects when changes occur to a registered document on the Internet. It is desired that minor changes to the document be filtered by the change-detection tool to reduce the number of change notifications sent to the user. It is also desired to give the user an indication of how significant the change is. It is desired to allow the user to identify relevant portions of a document so that the user is not notified of changes to other portions of the document. It is further desired to reduce storage requirements for the change-detection tool by storing a condensed checksum or signature of the registered document rather than storing the entire document.
A change-detection web server has a network connection for transmitting and receiving packets from a remote client and a remote document server. A responder is coupled to the network connection. The responder communicates with the remote client to register a document for change detection by receiving from the remote client a uniform-resource-locator (URL) identifying the document. The responder fetches the document from the remote document server and generates an original checksum for a checked portion of the document. The checked portion is less than the entire document.
A database is coupled to the responder. It receives the URL and the original checksum from the responder when the document is registered by the remote client. The database stores a plurality of records each containing a URL and a checksum for a registered document. A periodic minder is coupled to the database and the network connection. It periodically re-fetches the document from the remote document server by transmitting the URL from the database to the network connection. The periodic minder receives a fresh copy of the document from the remote document server. The periodic minder generates a fresh checksum of a portion of the fresh copy of the document and compares the fresh checksum to the original checksum. A detected change is signaled to the remote client when the fresh checksum does not match the original checksum.
Thus a change in the document is detected by comparing a checksum for the checked portion of the document. Changes in portions of the document outside the checked portion are not signaled to the remote client.
In further aspects the database does not store the document. The database stores a checksum for the document. Thus storage requirements for the database are reduced by archiving checksums and not entire documents.
In other aspects of the invention a selection means is coupled to the responder. It receives a selection from the remote client. The selection identifies boundaries of the checked portion of the document. A parsing means is coupled to the periodic minder. It parses the fresh copy and generates checksums for a plurality of portions of the fresh copy. A compare means is coupled to the parsing means. It signals a match when any of the checksums generated by the parsing means matches the original checksum from the database. Thus a change in the document is detected when the match is not signaled by the compare means. The parsing means generates a plurality of checksums for the plurality of portions of the fresh copy.
In still further aspects of the invention a length field indicates a size of the checked portion. The length field is written by the selection means. The parsing means generates each checksum for portions having the size of the checked portion. Thus the size of the checked portion is stored and used by the parsing means.
In further aspects the document is a hyper-text markup-language (HTML) document containing HTML tags. The HTML tags indicate formatting, layout, and hyper-links specifying URLs of other servers. The change-detection web server also has divider means coupled to the responder, for dividing the document into portions bound by the HTML tags. A checksum means generates original checksums. An original checksum is generated for each portion bound by HTML tags. The database stores the original checksums for the portions bound by the HTML tags. The periodic minder also has a second divider means which divides the fresh copy of the document into portions bound by the HTML tags. A second checksum means generates fresh checksums for portions of the fresh copy bound by HTML tags in the fresh copy of the document. A compare means receives the fresh checksums of the fresh copy from the second checksum means. It compares the fresh checksums to the original checksums from the database. A report means signals a change in the document when an original checksum for the document has no matching fresh checksum. Thus checksums are generated and stored for portions of the document bound by the HTML tags.
In further aspects the report means has a mailer means coupled to the network connection. It sends a change notification message to the remote client when the change is signaled. The responder receives an electronic-mail address from the remote client and stores the electronic-mail address of the remote client in the database. The mailer means reads the electronic-mail address from the database. The change notification message is sent to the remote client as an electronic-mail message addressed to the electronic-mail address. Thus the remote client is notified of the change by electronic mail.
FIG. 1 is a diagram of a change detection tool on a server on the Internet.
FIG. 2 shows a user registering a web page document for change detection.
FIG. 3 shows a periodic comparison of a registered web page document to determine if the document has changed.
FIG. 4 shows a document-change notice being generated and sent to the user.
FIG. 5 illustrates the operation of responder 24 of FIG. 1 when the registered document is an arbitrary, unstructured file.
FIG. 6 illustrates operation of minder 22 of FIG. 1 when the registered document has an arbitrary, unstructured format.
FIG. 7 is a diagram of an HTML document and a table of checksums for the HTML-delineated sections.
FIG. 8 illustrates the operation of responder 24 of FIG. 1 when the registered document is an HTML file.
FIG. 9 illustrates the operation of minder 22 of FIG. 1 when an HTML document is checked for recent changes.
FIG. 10 is a diagram illustrating an alternate embodiment which archives separate checksums for HTML-defined sections and checksums for user-defined sections.
The present invention relates to an improvement in Internet-document change-detection tools. The following description is presented to enable one of ordinary skill in the art to make and use the invention as provided in the context of a particular application and its requirements. Various modifications to the preferred embodiment will be apparent to those with skill in the art, and the general principles defined herein may be applied to other embodiments. Therefore, the present invention is not intended to be limited to the particular embodiments shown and described, but is to be accorded the widest scope consistent with the principles and novel features herein disclosed.
FIG. 1 is a diagram of a change detection tool on a server on the Internet. The user operates client 14 from a remote site on Internet 10. The user typically is operating a browser application, such as Netscape's Navigator or Microsoft's Internet Explorer. Client 14 communicates through Internet 10 by sending and receiving TCP/IP packets to establish connections with remote servers, typically using the hyper-text transfer protocol (http) of the world-wide web.
Client 14 retrieves web pages of files from document server 12 through Internet 10. These web pages are identified by a unique URL (uniform resource locator) which specifies a document file containing the text and graphics of a desired web page. Often additional files are retrieved when a document is retrieved. The "document" returned from document server 12 to client 14 is thus a composite document composed of several files of text, graphics, and perhaps sound or animation. The physical appearance of the web page on the user's browser on client 14 is specified by layout information embedded in non-displayed tags, as is well-known for HTML (hyper-text markup language) documents. Often these HTML documents contain tags with URL's that specify other web pages, perhaps on other web servers which may be physically located in different cities or countries. These tags create hyper-links to these other web servers allowing the user to quickly jump to other servers. These hyper-links form a complex web of linked servers across the world; hence the name "world-wide web".
The user may frequently retrieve files from remote document server 12. Often the same file is retrieved. The user may only be interested in differences in the file, or learning when the file is updated, such as when a new product or service is announced. The inventors have developed a software tool which automatically retrieves files and compares the retrieved files to an archived checksum of the file to determine if a change in the file has occurred. When a change is detected, the user is notified by an electronic mail message (e-mail). A copy of the new file may be attached to the e-mail notification, allowing the user to review the changes.
Rather than archive the source files from remote document server 12, the invention archives a checksum of CRC of the source files. These CRC's and the e-mail address of the user are stored in database 16 of change-detection server 20. Comparison is made of the stored or archived CRC of the document and a fresh CRC of the currently-available document. The CRC is a condensed signature or fingerprint of the document. Any change to the document changes the CRC. Aliasing of CRC's can be reduced to a very small probability by using sufficiently large CRC's, such as an 8-byte CRC. With an 8-byte CRC it is extremely improbable that a change to a document results in the same CRC being generated. If an identical CRC is generated, then the user is not notified of any change.
Change-detection server 20 performs three basic functions:
1. Register (setup) a web page document for change detection.
2. Periodically re-fetch the document and compare for changes
3. E-mail a change notice to the registered user if a change is detected.
Change-detection server 20 contains three basic components. Database 16 stores the archive of CRC's for registered web-page documents. The URL identifying the web page and the user's e-mail address are also stored with the archived CRC's. Responder 24 communicates with the user at client 14 to setup or register a web page document for change detection. Minder 22 periodically fetches registered documents from document server 12 through Internet 10. Minder 22 compares the archived CRC's in database 16 to new CRC's of the fetched documents to determine if a change has occurred. When a change is detected, minder 22 sends a notice to the user at client 14 that the document has changed.
FIG. 2 shows a user registering a web page document for change detection. The user on client 14 registers a web page document by specifying the URL which identifies the web page. A portion of the URL is translated into an IP address of a server by a domain-name server. The user also sends his e-mail address to responder 24. Responder 24 fetches the web page and displays the page to the user. The user then selects which portions of the web page document are to be compared for changes. The user can select paragraphs of text by dragging a highlight across the text. Responder 24 then stores the location of the selected text and generates one or more CRC for the selected text. Responder 24 then stores the CRC(s), URL, and e-mail address in database 16. A confirmation that the web page document has been registered is finally sent to the user on client 14.
FIG. 3 shows a periodic comparison of a registered web page document to determine if the document has changed. Each registered document is compared for changes on a periodic basis which depends on the number of registered documents and the speed of operation of change-detection server 20. Typically each document is compared every few days, although more frequent comparisons are possible.
Minder 22 reads the URL of the registered document from database 16. Minder 22 automatically fetches from document server 12 a fresh copy of the web-page document pointed to by the URL. Client 14 is not involved in this transaction. Occasionally the URL is deleted or does not respond, and a change is then signaled indicating that the URL could not be fetched. Change-detection server 20 may try to fetch the document again after several hours so that temporary shutdowns do not generate spurious change notices.
Once a fresh copy of the registered document has been fetched from the Internet, one or more CRC's of the fresh document are generated. These CRC's are compared to archived CRC's stored in database 16. A mis-compare of one or more CRC's indicates that the document changed.
FIG. 4 shows a document-change notice being generated and sent to the user. When a change has been detected by minder 22, a change notice is sent by e-mail to the registered user at client 14. The user's e-mail address is fetched from database 16 by minder 22. The new CRC's generated from the fresh copy of the registered document are written to database 16 so that future comparisons reflect the recent changes.
When the change that was detected is in a portion of the document not selected by the user when registering the document, a change notice is not sent. Thus changes to non-selected portions of a registered document do not generate change notices. This allows the user to filter out irrelevant changes, such as date changes or access counters which are frequently updated.
Changes can be detected in arbitrary documents which lack any structure. Various graphics image files and sound files may appear as arbitrary files. Most web pages are HTML files and have structure which can be exploited to improve change detection as discussed later. The methods for arbitrary documents can be applied to all non-HTML documents which are registered.
FIG. 5 illustrates the operation of responder 24 of FIG. 1 when the registered document is an arbitrary, unstructured file. The user initiates registration of a document by providing the URL identifying the document and the user's e-mail address. These can be provided by typing or pasting them into fields on a registration web page at change-detection server 20.
Change-detection server 20 uses the URL to fetch a copy of source document 30 from document server 12 of FIG. 1. Source document 30 could be any one of millions of documents on the thousands of web servers connected to the Internet. Source document 30 is displayed to the user, allowing the user to select portions of source document 30 for registration. The user can select portions of source document 30 by dragging a highlight with a mouse over the text to be selected. Alternately, the user can select whole paragraphs by triple-clicking anywhere inside these sections, or a single word or numeric value by double-clicking on the word. Changes which occur in unselected portions of source document 30 do not generate change notifications.
The selection information from the user is encoded as a string of length LEN1, with a starting location START. Parser 32 reads characters from source document 30 one at a time until the first character in the string at the starting location START is found.
START can simply be an offset in bytes or in characters from the beginning of the file to the beginning of the user's selection. Characters following START are sent from parser 32 to CRC generator 34 until the number of characters indicated by LEN1 is reached, indicating that the end of the selection has been reached. CRC generator 34 calculates the cyclic-redundancy-check (CRC) of these characters selected by the user from source document 30. Methods of generating CRC's and other checksums are well-known in the art and any of several methods can be used.
The CRC is typically generated by exclusive-ORing bits from a current character with a running checksum to generate a new checksum, which is then exclusive-ORed with bits from the next character. The final value of the running checksum, CRC1, is written to record 40 in database 16 of FIG. 1. The URL and the e-mail address from the user are also written to record 40. The length of the selection, LEN1, is also written to record 40, but the starting location is not. The starting location can change when changes are made to the web page document in the non-selected region before the selection, such as in a document header. Thus the starting location can change even when the selection has not changed, and changes in the header should be ignored.
The user may make several selections on the same source document 30, and each selection has it length and CRC stored in record 40. For example, the second user-selection stores LEN2 and CRC2 in record 40.
FIG. 6 illustrates operation of minder 22 of FIG. 1 when the registered document has an arbitrary, unstructured format. The minder performs change-detection on each of the thousands of documents having their URL's registered. Checking is preferably performed once for all users registering the same URL since this saves re-fetching documents for different users.
The minder begins by reading record 40 from database 16 of FIG. 1. The URL in record 40 is used to access the remote document server on the Internet and retrieve a fresh document copy 30′ of source document 30 which was registered as described for FIG. 5. Fresh document copy 30′ is parsed by parser 42 and each successive character of document copy 30′ is sent to CRC generator 44 until the stored length LEN1 is reached. A new CRC for this string from document copy 30′ is generated by CRC generator 44 and compared to the archived CRC1 in record 40 by comparator 46. If the archived CRC and the newly-generated CRC match, then the string has been found and no change has occurred.
If the CRC's do not match, then another string of length LEN1 starting at the next character in document copy 30′ is selected by parser 42 and its CRC generated and compared. This process continues through all possible strings of length LEN1 in document copy 30′ until a match has been found, indicating that a string matching the user's selection was found, or until the end of the document copy 30′, indicating that the user's selection was not found and therefore a change occurred. A change notice is then sent to the e-mail address stored in record 40.
While it may appear tedious to parse through fresh document copy 30′ an generate a CRC for each possible string of length LEN1, this process is quite rapid when executed by a general-purpose computer. The process can be accelerated by storing the first one or two characters in the selection along with the length and CRC in record 40. Parser 42 then parses the file looking for the first character followed by the second character and then generates a CRC only for strings having the correct first and second characters. This increases storage by 2 bytes per record, but reduces the number of strings generating a CRC by about ({fraction (1/25)}){circumflex over ( )}2 or a factor of 600.
The inventors have realized that most documents of interest on the Internet are HTML (hyper-text markup language) documents. HTML documents are structured because HTML tags are inserted into the document for hyper-links, formatting and layout. HTML tags are inserted before every paragraph, subheading, image, or hyper-link. Thus HTML documents are divided into sections by the HTML tags.
The inventors have realized that each section in an HTML document can be separately checksummed and CRC's for each section can be archived instead of one CRC for the entire document. Users can select sections and just these sections can be compared for changes. Thus change-detection can have a finer granularity, allowing minor changes in less relevant portions of a document to be ignored.
FIG. 7 is a diagram of an HTML document and a table of checksums for the HTML-delineated sections. HTML tags such as <tag1> begin and end each block or section of text. Typically each paragraph or heading begins and ends with an HTML tag. These HTML tags naturally define sections of the document.
Each of the sections defined by HTML tags can be separately checksummed. FIG. 7 shows a table constructed from the CRC's for each section. CRC1 is the checksum for the text in section 1, while CRC3 is the checksum for the text in section 3.
Ideally, the checksum is generated on the text between the HTML tags, and not on the HTML tags themselves. Since the HTML tags also define formatting, formatting changes can be filtered out by not including HTML tags in the checksum calculation. Thus minor changes due to formatting can be filtered out by skipping HTML tags when generating checksums.
FIG. 8 illustrates the operation of responder 24 of FIG. 1 when the registered document is an HTML file. The user initiates registration of a document by providing the URL identifying the document and the user's e-mail address. These can be provided by typing or pasting them into fields on a registration web page at change-detection server 20.
Change-detection server 20 uses the URL to fetch a copy of source document 30 from document server 12 of FIG. 1. Source document 30 could be any one of millions of HTML documents on the thousands of web servers connected to the Internet. Source document 30 is displayed to the user, allowing the user to select portions of source document 30 for registration.
Parser 62 reads characters from source document 30 and divides document 30 into sections. When parser 62 detects an HTML tag, a new section is begun with the next standard character. Thus Parser 62 divides source document 30 into sections defined by the HTML tags. Text in each of these sections is sent to CRC generator 64 which generates the checksum for that section. The checksum for each section is then stored in record 40′.
The user can select portions of source document 30 by dragging a highlight with a mouse over the text to be selected. Alternately, the user can select whole paragraphs by triple-clicking anywhere inside these sections, or double-clicking on a single word. The text could also be selected using cut-and-paste, or drag-and-drop. Changes which occur in unselected portions of source document 30 do not generate change notifications.
Selector 66 receives indications of where the user selected text in the document by mouse coordinates encoded in packets sent from the user's client. Selector 66 maps these mouse coordinates onto the HTML document to determine which sections were highlighted or selected by the user. Sections that were selected are enabled by setting a section enable bit 52 in record 40′. In this embodiment the entire section is enabled even when the user selects only a portion of the section between HTML tags. This results in a slightly larger area being selected that what the user desired, but since HTML tags separate all paragraphs, the additional portion of the section is relatively small, being no more than a paragraph in size. Record 40′ shows sections 2 and 3 being enabled by the user's selection while sections 1 and 4 are ignored for change detection.
FIG. 9 illustrates the operation of minder 22 of FIG. 1 when an HTML document is checked for recent changes. When record 40′ is to be checked, the URL is used to fetch a fresh copy of the source document, fresh document copy 30′. Parser 72 parses copy 30′ for HTML tags, and divides copy 30′ into another section when an HTML tag is found. Each section is sent to CRC generator 74, and a CRC for each section of fresh document copy 30′ is generated and stored in temporary table 80.
Once all sections of document copy 30′ have been checksummed, the archived checksums in record 40′ are compared to the fresh checksums in temporary table 80. Comparator 76 compares each enabled CRC in record 40′ to all CRC's stored in temporary table 80. If a match is found, then the section has not changed. However, if no match is found, then the section has changed.
Comparing each archived CRC to all new CRC's in temporary table 80 allows section to be re-ordered without a change being signaled. This filters out minor changes caused by re-ordering or changing the layout of a web page. A change is only signaled when the content of a selected section is changed.
Change column 82 is added to temporary table 80 to keep track of the type of changes found. A change code is written in column 82 for each section when a match is found or not found. When a match is found, the change code in column 82 is set to 00, indicating than no change occurred in this section. After all archived sections in record 40′ have been compared, when all change codes in column 82 are 00, then no new sections or changed were found. However, sections with change codes other than 00 indicate a change.
The change codes are initialized to 11 before processing. Any sections whose change codes remain 11 at the end of processing are new sections, and the user can be notified and these new sections highlighted in a copy of the new document sent to the user. Any enabled archived sections which have no matching CRC's in table 80 also cause a change notification to be sent, although the location of the change cannot be determined since the original document was not stored. When sections are deleted altogether, a copy of the deleted section cannot be recovered from the archived CRC.
FIG. 10 is a diagram illustrating an alternate embodiment which archives separate checksums for HTML-defined sections and checksums for user-defined sections. The concepts of the embodiments for both structured and arbitrary documents can be combined. HTML tags can be used to define sections which have separate checksums generated, while the user can define an arbitrary selection with its own checksum.
FIG. 10 shows an HTML document where the user selects part of the text from two different sections. The user selects the last portion of the text in section 2 and the first part of the text in section 3. Two CRC tables are generated for each registered document to allow change detection for the structured HTML sections and for arbitrary user-selected sections.
Structured-section table 90 contains a row for each section defined by the parser when an HTML tag is encountered. A CRC checksum is generated for each section. The user can optionally select which entire sections are enabled or disabled, or the section enable bits can be deleted from table 90.
Unstructured-section table 92 contains entries for sections that are defined by the user selecting text blocks on the source document. For each user selection, a selection number is assigned for tracking purposes. The structured section number or identifier is also stored to identify which of the structured sections of table 90 contains the beginning of the user's selection. The length in characters of bytes of the user's selection is also stored, and the CRC generated for the user's selection.
A separate pass through the parser and CRC generator is required for each user selection in table 92. The structured sections are first determined and checksummed, building table 90. Then the user-defined sections are parsed and their checksums generated and stored in table 92. The minder checks CRC's for both the structured sections of table 90 and the user-defined sections in table 92 in an analogous manner. The user can also skip defining selections when the whole document is relevant or the user is busy or inexperienced.
This embodiment has the advantages of having structured sections while still supporting user-defined sections. The computational work to generate and check the user-defined sections is reduced since the starting point is indicated by the structured section number in table 92. When the change-detection web server is unable to locate the starting section, an earlier section can be searched for the user section by generating CRC's for all strings of the defined length with starting points in the earlier section. More complex routines can also be used when documents have changed to locate the user-defined section. The new CRC's are written back to the database, and the user's registration may need to be changed to expand or delete a user-defined section which has changed.
Storing the CRC's for the structured sections improves change detection, since the section with the mismatching CRC's can be more easily isolated. When the mis-matching section is in a disabled portion of the source document, the change can be ignored. Mismatches in enabled sections or in the user-defined section are reported to the user. When the user-defined section has a CRC mismatch, the structured CRC's for sections within the user-defined section can be compared to localize the change within the user-defined section. Thus having two CRC tables allows the change to be localized when the user-defined section spans many structured sections.
The inventors have realized that having separate CRC's for sections of the document provides a way to generate change statistics. Instead of merely reporting that the was a change, the change notification can include statistics about the changes. For example, when two CRC's mismatch in a document with ten sections, then {fraction (2/10)}, or 20% of the document has changed. When all of the sections mismatch, then the entire document has changed. When only one section out of 20 sections change, no more than 5% of the document changed.
The percentage of the sections changed can be reported to the user with the change notification. This percent changed can be included in the subject field of the e-mail, allowing the user to discard small changes, but quickly find documents with major changes. A subject line might read "Change detected in yourfile.html: <10% changed" instantly telling the user that the change is less relevant than a message subject reading "Major Change detected in myfile.html: <70% changed".
The change-detection web server can change the subject based on the percentage of sections changed. When more than 50% of the sections change, the subject "Major Change Detected" is reported, while "Minor change detected" is reported when less than 10% of the sections change. Thus the user can be quickly alerted or more relevant changes.
The change-detection software can also have a minimum threshold of changes to generate a report. The user can set preferences so that changes affecting less than 10% of the document are not reported at all. Thus minor changes can be filtered out. When a user registers many web-page documents, a combined report could be generated which ranks the changed pages based on the percentage of sections with mismatching CRC's. Users do not have to select text in the document for this feature to be useful.
The change-detection tool described herein can determine not just that a change has occurred in a document: the structure of the changes to a document can be determined by localizing which parts of the document have been changed. These changed portions can be highlighted in the document and attached to the e-mailed change notice. Unchanged or unselected portions of the document can be deleted from report. The original document does not have to be stored; only CRC's from the document are archived.
Archiving CRC's of a document rather than the document itself vastly reduced storage requirements. For example, if 500,000 documents were registered, and each document averages 50 Kbytes, then 25 GigaBytes of storage are needed to store copies of the registered documents. Using the invention and storing an 8-byte CRC for each of ten sections per document requires only 40 megabytes, a reduction of storage by a factor of 600.
The invention reduces the time and effort required by a user wanting to keep abreast of changes at a web site. The user can specify the relevant portion of a web page, discarding corporate logo's, advertisements, headers and footers, and links to other web pages to focus on only textual information of interest. Since many web pages no feature flashy advertising graphics that are frequently changed and even rotated among several different ads or advertisers, the invention can be used to filter out these annoying changes. On the other hand, users who are themselves advertisers may only be interested in the advertising, and not the other content at the site ! The invention allows the user to select the portions of a web page that are relevant to that user.
The invention can determine the general location of the change although not the exact change by dividing the document or web page into smaller sections which are individually compared. Thus a section of a document can be highlighted, reducing the effort required by the user to review the changes.
The invention can automatically rank the change detected by indicating to the user how many sections have changed. The user can then ignore less comprehensive changes to a single section while being red-flagged to extensive changes to many sections of a document. The user may set preferences so that multiple sections must be changed before a notice is e-mailed. Thus single-section changes can be ignored at the user's option.
The invention can accumulate changes detected and combine them into a single report which is e-mailed to the user each month or other time period. The single report can list all the changes in all the register documents and even rank the changed document by the number of sections changed.
The user can optionally indicate the granularity of checking of a document by specifying user preferences for the document. Thus more critical documents can be divided into smaller sections, giving the user a better picture of how many changes have occurred. More casual users can have the documents divided into larger sections, saving storage space at the change-detection-tool web site. Power users can even be charged for using the advanced features while the general public is allowed to use the basic features free of charge. Thus power users can be charged for the additional storage required for registering fine-granularity documents while casual users can freely register documents using the coarse, storage-efficient settings.
Other web sites can include a brief message on their page that their users can be notified by e-mail when this page changes. The user selects the message and enters his or her e-mail address. The web site then sends an e-mail request to the change-detection tool at a different web site. The request contains the user's e-mail address and the URL of the web page. Thus existing web sites can be enhanced to provide update notices to users by including a brief message on the page itself. The change detection is handled in the normal way by the change-detection-tool's web site.
Webmasters may use the invention to keep track of linked pages. Many web pages contain hyper links to other web pages which often appear as underlined text. When the user clicks on hyper text, the URL of the hyper text is used to retrieve the referenced web page. Since the linked URL's may change, the links may fail unexpectedly. The webmaster can register all of the URL's for hyper links on his web page. Thus when any of the linked pages change, the webmaster is notified. Complete failures of these links are also detected by the change-detection tool. Thus webmasters can avoid the embarrassment of failed links by registering these links and having them automatically checked.
Several other embodiments are contemplated by the inventors. For example the tool has been described as for use in the public Internet, but it could also be used by private organizations behind a corporate firewall on an Intranet. Confidential process or product specifications could be stored as documents on a corporate Intranet, and employees could register the spec document's URL and thus be notified of any changes, and the relevancy of these changes. An engineer might only be interested in a portion of a process specification relating to his product and could register only that relevant portion of the spec document.
The change-detection tool can be located on a server separate from the web server itself and simply be called by the site's web server. A JAVA applet can be written to be executed by the browser client. This applet performs the functions of the responder, allowing the user to input registration information such as the e-mail address and URL. The document can first be fetched by the applet to the client, allowing the user to select a portion of the document. The applet could also generate the initial checksums, and send all this information to the change-detection tool web server once the user has finished registration. The applet reduces the loading on the responder, since these functions are performed at the client rather than at the server. The final registration information can then be mailed to the server with the change-detection-tool minder.
The invention has been described as operating on Internet documents. These documents are often complex web pages containing several individual files such as for graphics, text, and motion video and sound. Sometimes these files include small programs such as cgi scripts. Standard world-wide-web pages use the hyper-text-transfer protocol (http), but other protocols can be used in the URL. Gopher and file-transfer-program (ftp) documents can also be registered using their URL's.
Search engines can also be registered as a "document". The registered URL can include the search keywords. When the minder checks the URL for changes, the search is re-executed. The results of the search are compared to earlier results as the source document. Thus the document can be the output from execution of a search or another program. The document can thus be a temporary document or report rather than a static document. Webmasters can insert special tags into their HTML documents to disable change checking for portions of their pages that are frequently updated. An example is to disable change checking for access counters which are incremented each time a visitor accesses a page.
An enhancement which reduces storage requirements is to set a minimum size for a section of an HTML document. Sections smaller than this minimum size are combined with other sections until the minimum size is accumulated. Since headings and spurious text are usually separated by HTML tags, these headings can be combined with the following paragraph of text into a single section using this method. HTML tags for hyper-text links also can be combined with the surrounding paragraph by requiring a minimum size of an archived section. This enhancement reduces storage requirements since CRC's and section information is only stored for larger sections and not for single-line sections such as headings and hyper-links. In some embodiments, CRC's for disabled sections which were not selected by the user can be discarded. This reduces the storage requirements. In FIG. 8, CRC1 and CRC4 and their section-enable bits could be deleted from record 40′ since these sections are not selected. However, identifying the change is more difficult since the changed section is normally located by the unchanged surrounding sections.
Highlighting can be accomplished in a variety of ways. Placing characters in the left margin is a common way to highlight text. Some mail systems use color or other effects for highlighting. Premium service could check for changes more frequently than once a week or day, perhaps checking every hour or even every few minutes. A checksum can be generated by the CRC method, or by a hashing method, or by some other technique to produce a statistically unique compacted result. In addition to standard e-mail, the user can be notified immediately using a pager or personal-digital-assistant (PDA), or using a desktop push technology that continually sends updated Internet information to a user without using a standard browser or e-mail reader.
Change notification can be made for changes, documents moved to another URL, documents that can no longer be found, or re-ordered documents without other changes to the text in the sections that were re-ordered. The record for a registration can store URL's and e-mail addresses in separate databases to improve storage efficiency. The URL field in the registration is then an index into the URL database. The e-mail field is likewise an index into the e-mail or users database. Using indexes improves efficiency since an index is used to point to the longer URL's and e-mail addresses. Typically a URL is shared by several users, and an e-mail address is shared by several registrations.
The foregoing description of the embodiments of the invention has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed. Many modifications and variations are possible in light of the above teaching. It is intended that the scope of the invention be limited not by this detailed description, but rather by the claims appended hereto.
|Cited Patent
|Filing date
|Publication date
|Aug 18, 1988
|Feb 5, 1991
|Burkowski Forbes J
|Method of using signature subsets for indexing a textual database
|Feb 19, 1992
|Jun 7, 1994
|International Business Machines Corporation
|System for searching information using combinatorial signature derived from bits sets of a base signature
|Jun 26, 1991
|Sep 13, 1994
|International Business Machines Corporation
|Method and apparatus for saving and retrieving functional results
|Nov 19, 1990
|Oct 11, 1994
|International Business Machines Corporation
|System for substituting tags for non-editable data sets in hypertext documents and updating web files containing links between data sets corresponding to changes made to the tags
|Dec 19, 1991
|Feb 7, 1995
|Wang Laboratories, Inc.
|System for updating local views from a global database using time stamps to determine when a change has occurred
|Jun 18, 1992
|Apr 18, 1995
|Apple Computer, Inc.
|User interface system and method for traversing a database
|Nov 2, 1994
|Aug 29, 1995
|International Business Machines Corporation
|System for adjusting hypertext links with weighed user goals and activities
|Mar 30, 1993
|Dec 26, 1995
|Squibb Data Systems, Inc.
|Apparatus and method for reconstructing a file from a difference signature and an original file
|Dec 3, 1993
|Jan 9, 1996
|Millennium Software
|Generating a dynamic index for a file of user creatable cells
|Aug 29, 1994
|Jun 25, 1996
|Microsoft Corporation
|Method and system for handling text that includes paragraph delimiters of differing formats
|May 5, 1995
|Jul 9, 1996
|International Business Machines Corporation
|Method and system for reporting the status of an aggregate resource residing in a network of interconnected real resources
|Nov 17, 1993
|Jul 9, 1996
|Ricoh Company, Ltd.
|Document retrieval system involving ranking of documents in accordance with a degree to which the documents fulfill a retrieval condition corresponding to a user entry
|May 17, 1993
|Jul 16, 1996
|Hitachi, Ltd.
|Method of information reference for hypermedia
|Jul 27, 1994
|Jul 30, 1996
|Xerox Corporation
|Text retrieval method and system using signature of nearby words
|May 22, 1995
|Aug 6, 1996
|Xerox Corporation
|Method for performing a search of a plurality of documents for similarity to a plurality of query words
|Jun 20, 1996
|Sep 22, 1998
|Sun Microsystems, Inc.
|Automatic updates of bookmarks in a client computer
|"Assembling the Ultimate Browser-Notifiers", Matt Lake, CNET Reviews, Dec. 18, 1996.
|"Assembling the Ultimate Browser—Notifiers", Matt Lake, CNET Reviews, Dec. 18, 1996.
|URL-Minder FAQ, NetMind Services, Inc. Dec. 1996.
|Citing Patent
|Filing date
|Publication date
|Jun 15, 2001
|May 21, 2002
|Serena Software International, Inc.
|Method and apparatus for identifying the existence of differences between two files
|Dec 15, 1998
|Aug 13, 2002
|At&T Corp.
|Method for effective indexing of partially dynamic documents
|Nov 9, 1999
|Dec 3, 2002
|International Business Machines Corporation
|Method of transmitting streamlined data updates by selectively omitting unchanged data parts
|Jul 20, 2000
|Apr 22, 2003
|International Business Machines Corporation
|Database deltas using Cyclic Redundancy Checks
|Feb 25, 1999
|Jun 10, 2003
|Kabushiki Kaisha Toshiba
|Document management system and document management method applied thereto
|Dec 17, 1999
|Jul 29, 2003
|General Electric Company
|Method and system for verifying hyperlinks
|May 22, 2002
|Aug 12, 2003
|At&T Corp.
|Method for effective indexing of partially dynamic documents
|Oct 7, 1999
|Aug 12, 2003
|International Business Machines Corporation
|Updating of embedded links in World Wide Web source pages to have the new URLs of their linked target Web pages after such target Web pages have been moved
|Dec 14, 1999
|Oct 14, 2003
|Yodlee.Com, Inc.
|Method and apparatus for enabling real time monitoring and notification of data updates for WEB-based data synchronization services
|May 5, 1999
|Jan 20, 2004
|Xerox Corporation
|System for providing document change information for a community of users
|Dec 29, 1999
|Mar 2, 2004
|Nortel Networks Limited
|System and method for web page filtering
|Sep 30, 1998
|Mar 23, 2004
|International Business Machines Corporation
|System and method for detecting and repairing document-infecting viruses using dynamic heuristics
|Jun 26, 2001
|Mar 30, 2004
|Novell, Inc.
|Methods for reproducing and recreating original data
|Nov 15, 2000
|Apr 13, 2004
|Hewlett-Packard Development Company, L.P.
|Methods, computer system, and computer program product for configuring a meta search engine
|Aug 10, 1999
|Jul 13, 2004
|Akamai Technologies, Inc.
|Method and apparatus for selecting and viewing portions of web pages
|Mar 19, 1999
|Aug 10, 2004
|Fujitsu Limited
|Retrieval processing method and apparatus and memory medium storing program for same
|Dec 1, 1999
|Aug 31, 2004
|International Business Machines Corporation
|System and method for notifying of changes in web page hyperlinked documents
|Apr 14, 2000
|Oct 12, 2004
|Oki Electric Industry Co, Ltd.
|Operational supervisory system for a server
|Dec 23, 1999
|Dec 7, 2004
|International Business Machines Corporation
|Method and system for creating a byte stream characteristic number suitable for change quantification
|Aug 10, 1999
|Dec 21, 2004
|Akamai Technologies, Inc.
|Method and apparatus for notifying a user of changes to certain parts of web pages
|Apr 1, 2002
|Apr 12, 2005
|Pace Anti-Piracy
|Method for runtime code integrity validation using code block checksums
|Mar 18, 2002
|Aug 16, 2005
|Konica Corporation
|Order information acquiring method and order information controlling method for medical imaging system
|Jan 31, 2000
|Dec 27, 2005
|Intel Corporation
|Indicating the differences between Internet web pages
|Jan 19, 2001
|Jun 27, 2006
|Fujitsu Limited
|Automatic display method and apparatus for update information, and medium storing program for the method
|Feb 23, 2001
|Sep 12, 2006
|International Business Machines Corporation
|Method and apparatus for enhanced server page execution
|Mar 11, 2002
|Nov 21, 2006
|Kabushiki Kaisha Toshiba
|Paperless print
|Jan 16, 2002
|Feb 6, 2007
|Xerox Corporation
|Method and apparatus for collaborative document versioning of networked documents
|Oct 9, 2003
|Oct 30, 2007
|International Business Machines Corporation
|Guaranteeing hypertext link integrity
|Jul 10, 2000
|Mar 18, 2008
|Markmonitor, Inc.
|Method and system for searching and monitoring internet trademark usage
|Sep 18, 2000
|Jun 3, 2008
|Idom Technologies, Incorporated
|Method and apparatus for automatically updating website content
|Dec 4, 2002
|Jun 24, 2008
|International Business Machines Corporation
|Annotation validity using partial checksums
|Jul 28, 2000
|Aug 19, 2008
|Benno Henricus Nicolaas Hijl
|Method of identifying and registering entities and an assembly of hardware and software for applying such a method
|Sep 17, 2002
|Aug 26, 2008
|Hewlett-Packard Development Company, L.P.
|Published web page version tracking
|May 15, 2003
|Apr 14, 2009
|International Business Machines Corporation
|Marking changes based on a region and a threshold
|Feb 22, 2005
|May 19, 2009
|Yahoo ! Inc.
|Techniques for crawling dynamic web content
|Dec 10, 2004
|Jun 16, 2009
|Markmonitor Inc.
|Policing internet domains
|Oct 7, 2004
|Jul 7, 2009
|Google Inc.
|System and method for indicating web page modifications
|Aug 13, 2005
|Oct 27, 2009
|Yahoo! Inc.
|Unsupervised, automated web host dynamicity detection, dead link detection and prerequisite page discovery for search indexed web pages
|Nov 30, 2004
|Feb 2, 2010
|Interwoven, Inc.
|System for transactionally deploying content across multiple machines
|Mar 28, 2007
|Mar 16, 2010
|Scenera Technologies, Llc
|Method and system for managing dynamic associations between folksonomic data and resources
|Feb 21, 2002
|Mar 30, 2010
|International Business Machines Corporation
|Protocol to fix broken links on the world wide web
|Dec 28, 2006
|Apr 13, 2010
|Xerox Corporation
|Method and apparatus for collaborative document versioning of networked documents
|Apr 30, 2003
|Apr 20, 2010
|International Business Machines Corporation
|Method and apparatus for marking of web page portions for revisiting the marked portions
|May 20, 2004
|May 25, 2010
|Google Inc.
|Scheduler for search engine crawler
|Jun 2, 2005
|Aug 17, 2010
|Canon Kabushiki Kaisha
|Information-processing apparatus and method for processing document
|May 31, 2006
|Nov 9, 2010
|Microsoft Corporation
|Displaying interrelated changes in a grid
|Jun 29, 2007
|Dec 7, 2010
|Walter Hoffmann
|Method and system for tracking authorship of content in data
|Jul 29, 2005
|Feb 22, 2011
|Bit 9, Inc.
|Content tracking in a network security system
|Jan 14, 2008
|Mar 22, 2011
|International Business Machines Corporation
|System and method for data management through decomposition and decay
|Aug 30, 2004
|Jul 26, 2011
|Google Inc.
|Minimizing visibility of stale content in web searching including revising web crawl intervals of documents
|Mar 24, 2009
|Aug 2, 2011
|Google Inc.
|Managing URLs
|Jun 30, 2004
|Oct 18, 2011
|Google Inc.
|Scheduler for search engine crawler
|Jul 9, 2007
|Mar 13, 2012
|International Business Machines Corporation
|Guaranteeing hypertext link integrity
|Oct 13, 2008
|Mar 13, 2012
|Adobe Systems Incorporated
|Converting a graphic object from a first format to a second format with the aid of a stored checksum
|Apr 30, 2008
|Mar 20, 2012
|International Business Machines Corporation
|Annotation validity using partial checksums
|May 25, 2010
|Apr 17, 2012
|Google Inc.
|Scheduler for search engine crawler
|Sep 13, 2010
|Jul 3, 2012
|International Business Machines Corporation
|Data management through decomposition and decay
|Feb 20, 2001
|Jul 10, 2012
|Mcafee, Inc.
|Unwanted e-mail filtering system including voting feedback
|Feb 29, 2008
|Jul 17, 2012
|Kemp Richard Douglas
|Computerized document examination for changes
|Sep 4, 2012
|Hoshiko Llc
|Method and apparatus for identifying and characterizing errant electronic files
|Jul 29, 2005
|Sep 18, 2012
|Bit 9, Inc.
|Centralized timed analysis in a network security system
|Jul 21, 2008
|Oct 9, 2012
|Workshare Technology, Inc.
|Methods and systems to fingerprint textual information using word runs
|Feb 2, 2011
|Oct 23, 2012
|Sdl International America Incorporated
|Globalization management system and method therefor
|Nov 18, 2009
|Dec 11, 2012
|American Express Travel Related Services Company, Inc.
|File listener system and method
|Jul 17, 2007
|Jan 8, 2013
|Intertrust Technologies Corp.
|Selective sending of portions of electronic content
|Feb 22, 2011
|Feb 26, 2013
|Google Inc.
|Scheduling a recrawl
|Jul 15, 2011
|Feb 26, 2013
|Google Inc.
|Managing URLs
|Jun 22, 2011
|Mar 26, 2013
|Google Inc.
|Minimizing visibility of stale content in web searching including revising web crawl intervals of documents
|Apr 28, 2011
|Apr 30, 2013
|Motionpoint Corporation
|Dynamic language translation of web site content
|Dec 22, 2003
|May 28, 2013
|Oracle International Corporation
|System and method for verifying intended contents of an electronic message
|Jul 27, 2010
|Jun 25, 2013
|Workshare Technology, Inc.
|Methods and systems for comparing presentation slide decks
|Mar 21, 2002
|Jul 9, 2013
|International Business Machines Corporation
|High-speed content transformation engine
|Sep 11, 2008
|Oct 8, 2013
|Workshare Technology, Inc.
|Methods and systems for protect agents using distributed lightweight fingerprints
|Oct 30, 2009
|Oct 22, 2013
|Motionpoint Corporation
|Analyzing web site for translation
|Feb 9, 2006
|Dec 3, 2013
|Mcafee, Inc.
|System, method and computer program product for gathering information relating to electronic content utilizing a DNS server
|Oct 24, 2012
|Dec 31, 2013
|Workshare Technology, Inc.
|Methods and systems for preventing unauthorized disclosure of secure information using image fingerprinting
|Aug 10, 2012
|Jan 21, 2014
|Ebay Inc.
|Automatic update of searches
|Apr 25, 2005
|Mar 4, 2014
|Google Inc.
|Managing items in crawl schedule
|Oct 24, 2012
|Mar 11, 2014
|Workshare Technology, Inc.
|Methods and systems for image fingerprinting
|Apr 28, 2011
|Mar 25, 2014
|Microsoft Corporation
|Making document changes by replying to electronic messages
|Jun 30, 2004
|Apr 22, 2014
|Google Inc.
|Document reuse in a search engine crawler
|Feb 18, 2011
|Apr 22, 2014
|Google Inc.
|Scheduler for search engine crawler
|May 1, 2012
|Jul 1, 2014
|Symantec Operating Corporation
|Method and apparatus for selectively storing blocks of data on a server
|Apr 17, 2012
|Jul 8, 2014
|Google Inc.
|Scheduler for search engine crawler
|Mar 22, 2013
|Jul 15, 2014
|Google Inc.
|Minimizing visibility of stale content in web searching including revising web crawl intervals of documents
|Dec 1, 2010
|Jul 22, 2014
|International Business Machines Corporation
|Notification of configuration updates in a cluster system
|Mar 24, 2012
|Sep 16, 2014
|Mcafee, Inc.
|Unwanted e-mail filtering system including voting feedback
|Dec 1, 2010
|Jan 27, 2015
|International Business Machines Corporation
|Self-assignment of node identifier in a cluster system
|Jan 15, 2013
|Feb 3, 2015
|Motionpoint Corporation
|Dynamic language translation of web site content
|May 6, 2011
|Feb 24, 2015
|Microsoft Technology Licensing, Llc
|Changes to documents are automatically summarized in electronic messages
|Jul 29, 2005
|Mar 17, 2015
|Bit9, Inc.
|Content extractor and analysis system
|Oct 8, 2004
|Mar 24, 2015
|At&T Intellectual Property I, L.P.
|Systems and methods for automatically providing alerts of web site content updates
|Aug 31, 2006
|Apr 21, 2015
|International Business Machines Corporation
|System and method for resource-adaptive, real-time new event detection
|Dec 1, 2010
|Jun 30, 2015
|International Business Machines Corporation
|Propagation of unique device names in a cluster system
|Nov 18, 2009
|Jul 28, 2015
|Workshare Technology, Inc.
|Methods and systems for exact data match filtering
|Jul 13, 2011
|Sep 8, 2015
|Motionpoint Corporation
|Dynamic language translation of web site content
|Apr 28, 2011
|Sep 15, 2015
|Microsoft Technology Licensing, Llc
|Uploading attachment to shared location and replacing with a link
|Apr 6, 2001
|Nov 22, 2001
|Scott Adam Marc
|Method and system for website content integrity assurance
|Mar 22, 2001
|Nov 22, 2001
|Robert Bradshaw
|Method and apparatus for automatically deploying data in a computer network
|May 31, 2001
|Dec 6, 2001
|Nec Corporation
|Method and system for client-server communication
|Jan 4, 2001
|Feb 21, 2002
|Kabushiki Kaisha Network Doc
|Falsification preventing apparatus, falsification preventing method and recording medium therefor
|Aug 27, 2001
|Jun 13, 2002
|Fujitsu Limited
|Related documents processing device, recording medium for processing related documents and method for processing related documents
|Mar 18, 2002
|Oct 3, 2002
|Eiichi Akagi
|Order information acquiring method and order information controlling method for medical imaging system
|Dec 4, 2002
|Jun 10, 2004
|International Business Machines Corporation
|Annotation validity using partial checksums
|Mar 17, 2004
|Sep 9, 2004
|Mark Tsimelzon
|Method and apparatus for selecting and viewing portions of web pages
|Apr 30, 2003
|Nov 4, 2004
|International Business Machines Corporation
|Method and apparatus for marking of web page portions for revisiting the marked portions
|May 15, 2003
|Nov 18, 2004
|International Business Machines Corporation
|Marking changes based on a region and a threshold
|Oct 2, 2003
|Dec 30, 2004
|International Business Machines Corporation
|Hypertext request integrity and user experience
|Oct 9, 2003
|Jan 27, 2005
|International Business Machines Corporation
|Guaranteeing hypertext link integrity
|Oct 8, 2004
|Mar 3, 2005
|Bedingfield James C.
|Systems and methods for automatically providing alerts of web site content updates
|Nov 25, 2003
|May 19, 2005
|Shin Torigoe
|Web page update notification method and web page update notification device
|Nov 20, 2003
|May 26, 2005
|International Business Machines Corporation
|Method and apparatus for marking of web pages
|Dec 22, 2003
|Jun 23, 2005
|Oracle International Corporation
|System and method for verifying intended contents of an electronic message
|Dec 3, 2004
|Jul 14, 2005
|David Meltzer
|Real-time change detection for network systems
|Jan 6, 2005
|Jul 21, 2005
|Todd Scallan
|System and method for metadata-based distribution of content
|May 16, 2005
|Sep 22, 2005
|Forgent Networks, Inc.
|Asynchronous collaboration via audio/video annotation
|Mar 3, 2005
|Sep 29, 2005
|Oki Electric Industry Co., Ltd.
|Update notification method and update notification apparatus of web page
|Jun 2, 2005
|Dec 8, 2005
|Canon Kabushiki Kaisha
|Information-processing apparatus and method for processing document
|Dec 2, 2004
|Jun 8, 2006
|Niklas Heidloff
|Method and system for automatically providing notifications regarding interesting content from shared sources based on important persons and important sources for a user
|Aug 13, 2005
|Dec 28, 2006
|Parashuram Kulkami
|Unsupervised, automated web host dynamicity detection, dead link detection and prerequisite page discovery for search indexed web pages
|Aug 23, 2005
|Mar 8, 2007
|Cisco Technology, Inc.
|Method and system for monitoring a server
|Mar 1, 2008
|Jun 26, 2008
|Marengo Intellectual Property Ltd.
|Integrity Checker for Web Browser Document
|Jul 21, 2008
|Jan 21, 2010
|Workshare Technology, Inc.
|Methods and systems to fingerprint textual information using word runs
|Nov 18, 2010
|Gary Stephen Shuster
|Method and apparatus for identifying and characterizing errant electronic files
|Nov 18, 2009
|May 19, 2011
|American Express Travel Related Services Company, Inc.
|File listener system and method
|Jul 9, 2009
|Jul 7, 2011
|Xueli Chen
|Web page tamper-froof device, method and system
|Feb 27, 2012
|Jul 12, 2012
|Stollman Jeff
|Methods and apparatus related to document processing based on a document type
|Nov 29, 2012
|Ebay Inc.
|Automatic update of searches
|May 2, 2013
|Eamonn O'Brien-Strain
|Profile driven extraction
|Dec 27, 2003
|Aug 8, 2007
|A method for determining data packet checksum after data modification
|Nov 12, 2004
|Oct 21, 2009
|Method and apparatus for marking of web pages
|Mar 22, 2001
|Sep 27, 2001
|Robert Bradshaw
|Method and apparatus for automatically deploying data in a computer network
|Apr 6, 2001
|Oct 18, 2001
|Predictive Systems Inc
|Method and system for website content integrity
|Jul 2, 2002
|Jan 16, 2003
|Eggen Gudbrand
|Apparatus for searching on internet
|U.S. Classification
|International Classification
|Cooperative Classification
|European Classification
|Aug 9, 1999
Owner name: NETMIND TECHNOLOGIES, INC., CALIFORNIA
Free format text: CORPORATE NAME CHANGE (RESTATED ARTICLES OF INCORPORATION, WITH APPENDIX);ASSIGNOR:NETMIND SERVICES, INC.;REEL/FRAME:010154/0267
Effective date: 19980929
|Oct 18, 2004
|Fee payment
Year of fee payment: 4
|Sep 24, 2008
|Fee payment
Year of fee payment: 8
|May 7, 2009
Owner name: NOKIA CORPORATION, FINLAND
Free format text: MERGER;ASSIGNOR:NETMIND TECHNOLOGIES, INC.;REEL/FRAME:022645/0362
Effective date: 20060328
|May 8, 2009
Owner name: INTELLISYNC CORPORATION, CALIFORNIA
Free format text: MERGER;ASSIGNOR:NETMIND TECHNOLOGIES, INC.;REEL/FRAME:022659/0737
Effective date: 20060328
|Sep 19, 2012
|Fee payment
Year of fee payment: 12

subset: commoncrawl


text:
Do our best
Benaraby State School is the oldest in the district. With an enrolment of approximately 109 children the school is forging for itself a reputation for excellence that brings pride to the district.
At Benaraby we have the country feel, with large grounds consisting of two ovals surrounded by bushland. We also have the small school benefit with great sporting and cultural opportunities and still close enough to interact with the schools of the Gladstone District.
Congratulations to Maya, Jacob and Piper. You are now apart of the Port Curtis Athletic Team. ...
Benaraby State Schools Fair is on again on Sunday August 9th.
All Day Rides can be purchased...
Congratulations to Dampier on winning the school cross country.
Students in Prep to year 3 enjoyed an afternoon of parading their hats to parents.
View the current annual report
View the current Newsletter
© The State of Queensland (Department of Education and Training) 2015