hunk.code_window:                     episode.batch_builder.total(),
                       episode.batch_builder.count) + "are buffered in "
                   "the sampler. If this is more than you expected, check that "
                   "that you set a horizon on your environment correctly. Note "
                   "that in multi-agent environments, `sample_batch_size` sets "
                   "the batch size based on environment steps, not the steps of "
                   "individual agents, which can result in unexpectedly large "
  
hunk.labels: keep keep keep replace replace keep keep
hunk.after_edit:                 "that you set a horizon on your environment correctly and that"
                   " it terminates at some point. "
                   "Note: In multi-agent environments, `sample_batch_size` sets "
  
hunk.file_path: rllib/evaluation/sampler.py
hunk.type: replace
file: class CollectorError(Exception):
      """Error raised from the collector service."""
  
      pass
  
  
  class DatabaseError(Exception):
      """Error raised from the database manager."""
  
      pass
  