fdc5e7d5_Robots_txt_Tutorial__3
[0] robots.txt [1] no [2] If document is linked to, it may appear URL only, or with data from links or trusted third party data sources like the ODP [4] People can look at your robots.txt file to see what content you do not want indexed. Many new launches are discovered by people watching for changes in a robots.txt file. Using wildcards incorrectly can be expensive! [5] User-agent: * Disallow: /folder/ OR User-agent: * Disallow: /file.html Complex wildcards can also be used. [3] 
yes
Robots.txt Tutorial
3