fastapi
uvicorn
torch
transformers
accelerate
bitsandbytes
pydantic
protobuf
sentencepiece