title: robots.txt - exclude any URL that contains "/node/"
body: <p>How do I tell crawlers / bots not to index any URL that has /node/ pattern?
  Following is since day one but I noticed that Google has still indexed a lot of URLs that has
  /node/ in it, e.g. www.mywebsite.com/node/123/32</p>
  
  <p>Disallow: /node/</p>
  
  <p>Is there anything that states that do not index any URL that has /node/
  Should I write something like following:
  Disallow: /node/*</p>
  
  <p>Update:
  The real problem is despite:
  Disallow: /node/
  in robots.txt, Google has indexed pages under this URL e.g. www.mywebsite.com/node/123/32</p>
  
  <p>/node/ is not a physical directory, this is how drupal 6 shows it's content, I guess this is my problem that node is not a directory, merely part of URLs being generated by drupal for the content, how do I handle this? will this work?</p>
  
  <p>Disallow: /*node</p>
  
  <p>Thanks</p>