transformers
torch
fastapi
uvicorn
vllm==0.5.1