prompt: We are currently solving the following issue within our repository. Here is the issue text:
  --- BEGIN ISSUE ---
  [v0.3.1] Release Tracker
  **ETA**: Feb 14-16 th
  
  ## Major changes
  
  TBD
  
  ## PRs to be merged before the release
  
  - [x] #2855 
  - [x] #2845 
  - [x] ~~#2514~~
  - [x] Ensure memory release when `LLM` class is deleted. #2882 
  - [x] #2875 #2880
  
  --- END ISSUE ---
  
  Below are some code segments, each from a relevant file. One or more of these files may contain bugs.
  --- BEGIN FILES ---
  Path: `vllm/__init__.py`
  Content:
  ```
  1 """vLLM: a high-throughput and memory-efficient inference engine for LLMs"""
  2 
  3 from vllm.engine.arg_utils import AsyncEngineArgs, EngineArgs
  4 from vllm.engine.async_llm_engine import AsyncLLMEngine
  5 from vllm.engine.llm_engine import LLMEngine
  6 from vllm.engine.ray_utils import initialize_cluster
  7 from vllm.entrypoints.llm import LLM
  8 from vllm.outputs import CompletionOutput, RequestOutput
  9 from vllm.sampling_params import SamplingParams
  10 
  11 __version__ = "0.3.0"
  12 
  13 __all__ = [
  14     "LLM",
  15     "SamplingParams",
  16     "RequestOutput",
  17     "CompletionOutput",
  18     "LLMEngine",
  19     "EngineArgs",
  20     "AsyncLLMEngine",
  21     "AsyncEngineArgs",
  22     "initialize_cluster",
  23 ]
  24
  ```
  --- END FILES ---
  
  Please first localize the bug based on the issue statement, and then generate a patch according to the `git diff` format fenced by three backticks.
  
  Here is an example:
  
  ```diff
  diff --git a/examples/server_async.py b/examples/server_async.py
  --- a/examples/server_async.py
  +++ b/examples/server_async.py
  @@ -313,4 +313,4 @@
   
   
   if __name__ == "__main__":
  -    asyncio.run(run_async_server("."), debug=True)
  +    asyncio.run(run_async_server(), debug=True)
  diff --git a/examples/server_sync.py b/examples/server_sync.py
  --- a/examples/server_sync.py
  +++ b/examples/server_sync.py
  @@ -313,5 +313,5 @@
   
   
   if __name__ == "__main__":
  -    server = run_sync_server(".")
  +    server = run_sync_server()
       server.shutdown()
  
  ```
  
golden_diff: diff --git a/vllm/__init__.py b/vllm/__init__.py
  --- a/vllm/__init__.py
  +++ b/vllm/__init__.py
  @@ -8,7 +8,7 @@
   from vllm.outputs import CompletionOutput, RequestOutput
   from vllm.sampling_params import SamplingParams
   
  -__version__ = "0.3.0"
  +__version__ = "0.3.1"
   
   __all__ = [
       "LLM",
  
verification_info: {"golden_diff": "diff --git a/vllm/__init__.py b/vllm/__init__.py\n--- a/vllm/__init__.py\n+++ b/vllm/__init__.py\n@@ -8,7 +8,7 @@\n from vllm.outputs import CompletionOutput, RequestOutput\n from vllm.sampling_params import SamplingParams\n \n-__version__ = \"0.3.0\"\n+__version__ = \"0.3.1\"\n \n __all__ = [\n     \"LLM\",\n", "issue": "[v0.3.1] Release Tracker\n**ETA**: Feb 14-16 th\r\n\r\n## Major changes\r\n\r\nTBD\r\n\r\n## PRs to be merged before the release\r\n\r\n- [x] #2855 \r\n- [x] #2845 \r\n- [x] ~~#2514~~\r\n- [x] Ensure memory release when `LLM` class is deleted. #2882 \r\n- [x] #2875 #2880\n", "before_files": [{"content": "\"\"\"vLLM: a high-throughput and memory-efficient inference engine for LLMs\"\"\"\n\nfrom vllm.engine.arg_utils import AsyncEngineArgs, EngineArgs\nfrom vllm.engine.async_llm_engine import AsyncLLMEngine\nfrom vllm.engine.llm_engine import LLMEngine\nfrom vllm.engine.ray_utils import initialize_cluster\nfrom vllm.entrypoints.llm import LLM\nfrom vllm.outputs import CompletionOutput, RequestOutput\nfrom vllm.sampling_params import SamplingParams\n\n__version__ = \"0.3.0\"\n\n__all__ = [\n    \"LLM\",\n    \"SamplingParams\",\n    \"RequestOutput\",\n    \"CompletionOutput\",\n    \"LLMEngine\",\n    \"EngineArgs\",\n    \"AsyncLLMEngine\",\n    \"AsyncEngineArgs\",\n    \"initialize_cluster\",\n]\n", "path": "vllm/__init__.py"}], "after_files": [{"content": "\"\"\"vLLM: a high-throughput and memory-efficient inference engine for LLMs\"\"\"\n\nfrom vllm.engine.arg_utils import AsyncEngineArgs, EngineArgs\nfrom vllm.engine.async_llm_engine import AsyncLLMEngine\nfrom vllm.engine.llm_engine import LLMEngine\nfrom vllm.engine.ray_utils import initialize_cluster\nfrom vllm.entrypoints.llm import LLM\nfrom vllm.outputs import CompletionOutput, RequestOutput\nfrom vllm.sampling_params import SamplingParams\n\n__version__ = \"0.3.1\"\n\n__all__ = [\n    \"LLM\",\n    \"SamplingParams\",\n    \"RequestOutput\",\n    \"CompletionOutput\",\n    \"LLMEngine\",\n    \"EngineArgs\",\n    \"AsyncLLMEngine\",\n    \"AsyncEngineArgs\",\n    \"initialize_cluster\",\n]\n", "path": "vllm/__init__.py"}]}