title: What robots.txt means in this line?
body: <p>I want to scrape some data from a website which robots.txt file contain this, is not this means I can scrape from anywhere but wp-admin ?
  Also is there any other way from which I can know that website allow scraping/crawling without any blocking ?
  For scraping I use Python Scrapy Framework.</p>
  
  <pre><code>User-agent: *
  Disallow: /wp-admin/
  Allow: /wp-admin/admin-ajax.php
  </code></pre>