title: Disallow or Noindex on Subdomain with robots.txt
body: <p>I have dev.example.com and www.example.com hosted on different subdomains. I want crawlers to drop all records of the <code>dev</code> subdomain but keep them on <code>www</code>. I am using git to store the code for both, so ideally I'd like both sites to use the same robots.txt file.</p>
  
  <p>Is it possible to use one robots.txt file and have it exclude crawlers from the <code>dev</code> subdomain?</p>