Robots.txt and language exclusion I want to add a language on my drupal 6 site but I want that Google doesn't index every page in this language (fr).

Can I use robots.txt and and add something like this?

Disallow: /fr/*
Drupal by default comes with robots.txt file. You can find the file in Drupal Root.

Yes, you can go ahead and change. Below code also should work.

Disallow: /fr/


But, if you use 

Disallow: /fr/*


As per wikipedia


  Universal * match The Robot Exclusion Standard does not mention
  anything about the * character in the Disallow: statement. Some
  crawlers like Googlebot and Slurp recognize strings containing *,
  while MSNbot and Teoma interpret it in different ways.