title: Multiple User-agents: * in robots.txt
body: <p>Related question: <a href="https://stackoverflow.com/questions/14710324/multiple-user-agents-in-robots-txt">Multiple User Agents in Robots.txt</a></p>
  
  <p>I'm reading a robots.txt file on a certain website and it seems to be contradictory to me (but I'm not sure).</p>
  
  <pre><code>User-agent: *
  Disallow: /blah
  Disallow: /bleh
  ...
  ... 
  ...several more Disallows
  
  User-agent: *
  Allow: /
  </code></pre>
  
  <p>I know that you can exclude certain robots by specifying multiple User-agents, but this file seems to be saying that all robots are disallowed of a bunch of files but also allowed to access all the files? Or am I reading this wrong.</p>