21412f90____An_ASP_Spider_Search_system__Description
[Date] Some time in the future [Release] ? [Description] 
Yider additions in approximate order of importance: Allow spidering of Word and PDF files Create an API to only index one page at a time Spider files in robots.txt files Ability to allow searching of sites that are indeitcal, sit on the same machine but are listed under multiple domains. Ability to define the structure of links rather than just searching for href and src tags Ability to give certain search words more importance and/or rank URL matches with those words more highly Create a GUI for all variables in configuration.asp Display the results of URLs parsed, URLs not parsed, pages not parsed, badly formed URLs and all other options visually Warn the user when server timeouts are occuring .NET searching Spell checking For those with physical or terminal services access to the server, a .vbs or executable that could be scheduled in Task Manager, run from the commandline, etc
Yider 0.5 - An ASP Spider/Search system
Description