class_docstr: This class provides a set of methods to read, parse and answer
  questions about a single robots.txt file.
docstr: Reads the robots.txt URL and feeds it to the parser.
docstr_tok: ["Reads","the","robots.txt","URL","and","feeds","it","to","the","parser","."]
code: def read(self):
      """Reads the robots.txt URL and feeds it to the parser."""
      try:
          f = urllib.request.urlopen(self.url)
      except urllib.error.HTTPError as err:
          if err.code in (401, 403):
              self.disallow_all = True
          elif err.code >= 400 and err.code < 500:
              self.allow_all = True
      else:
          raw = f.read()
          self.parse(raw.decode("utf-8").splitlines())
  
imports: import collections
  import urllib.parse
  import urllib.request
label_desc: Use image node_id 5 for calling the RobotFileParser obj's underlying member method code with example usage: obj.read() without return types