title: robots.txt file
body: <p>I have a url that I like to restrict the search engines from going to:</p>
  
  <p>Is the following acceptable:</p>
  
  <pre><code>    User-agent: *
      Disallow: https://mysite.com/
  </code></pre>
  
  <p>or do I need to put something more like:</p>
  
  <pre><code>    User-agent: *
      Disallow: https://mysite.com/index.aspx
  </code></pre>
  
  <p>or would I just put:</p>
  
  <pre><code>    User-agent: *
      Disallow: /index.aspx
  </code></pre>