fastapi
uvicorn
pydantic
torch
transformers
accelerate
bitsandbytes