1. A method for crawling a web site, the method comprising: querying a web site server by a crawler program, wherein at least one page of the web site has a reference, wherein the reference is specified by a script to produce an address for a next page; parsing such a reference from one of the web pages by the crawler program and sending the reference to an applet running in a browser; and determining the address for the next page by the browser executing the reference and sending the address to the crawler, wherein the crawler automatically selects non-hypertext-link parameters from the one web page of the web site server by performing a programmed action sequence, including selecting items from lists of the one web page in a particular sequence, and the crawler sends the applet running in the browser, for the query to the web server for the next page referenced by the one web page, the selected parameters and a context arising from the particular sequence.