class_docstr: A class for trace down all the requests, abstraction for async
class_docstr_tok: ["A","class","for","trace","down","all","the","requests",",","abstraction","for","async"]
docstr: Add a request to be sent to the engine on the next background
  loop iteration.
docstr_tok: ["Add","a","request","to","be","sent","to","the","engine","on","the","next","background","loop","iteration","."]
code: def add_request(self, request_id: str):
      """Add a request to be sent to the engine on the next background
      loop iteration."""
      self._requests.put_nowait(request_id)
      self.new_requests_event.set()
  
file_path: ColossalAI/colossalai/legacy/inference/async_engine.py
imports: import asyncio
  from colossalai.inference.dynamic_batching.ray_dist_init import Driver
  from .dynamic_batching.io_struct import RequestOutput
  from .dynamic_batching.sampling_params import SamplingParams
label_desc: Use image node_id 4 for calling the RequestTracker obj's underlying member method code with example usage: obj.add_request(request_id) without return types