fastapi
uvicorn
torch
transformers
accelerate
pydantic
scikit-learn
bitsandbytes>=0.41.0