Instructions to use SupraLabs/Supra-Mini-v4-2M with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use SupraLabs/Supra-Mini-v4-2M with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="SupraLabs/Supra-Mini-v4-2M")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("SupraLabs/Supra-Mini-v4-2M")
model = AutoModelForCausalLM.from_pretrained("SupraLabs/Supra-Mini-v4-2M")

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use SupraLabs/Supra-Mini-v4-2M with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "SupraLabs/Supra-Mini-v4-2M"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "SupraLabs/Supra-Mini-v4-2M",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/SupraLabs/Supra-Mini-v4-2M

SGLang

How to use SupraLabs/Supra-Mini-v4-2M with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "SupraLabs/Supra-Mini-v4-2M" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "SupraLabs/Supra-Mini-v4-2M",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "SupraLabs/Supra-Mini-v4-2M" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "SupraLabs/Supra-Mini-v4-2M",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use SupraLabs/Supra-Mini-v4-2M with Docker Model Runner:
```
docker model run hf.co/SupraLabs/Supra-Mini-v4-2M
```

Supra-Mini-v4-2M / README.md

Commit History

Update README.md

1a23871
verified

Harley-ml commited on 4 days ago

Update README.md

5a1a8f5
verified

LH-Tech-AI commited on 6 days ago

Update README.md

bf1bea9
verified

Harley-ml commited on 6 days ago

Update README.md

cc38ce4
verified

Harley-ml commited on 6 days ago

Update README.md

5c33dbd
verified

Harley-ml commited on 6 days ago

Update readme.md, fix vocab (8192 -> 4096) (#3)

06d9b0d

LH-Tech-AI

Datdanboi25 commited on 7 days ago

Update README.md

74d1409
verified

LH-Tech-AI commited on 8 days ago

Update README.md

5aa1cce
verified

LH-Tech-AI commited on 9 days ago

Update README.md

77bdd2a
verified

LH-Tech-AI commited on 10 days ago

Update README.md

d999f97
verified

LH-Tech-AI commited on 10 days ago

Update README.md

4d8695c
verified

LH-Tech-AI commited on 10 days ago

Create README.md

5c71983
verified

LH-Tech-AI commited on 10 days ago

Commit History

Update README.md 1a23871 verified

Update README.md 5a1a8f5 verified

Update README.md bf1bea9 verified

Update README.md cc38ce4 verified

Update README.md 5c33dbd verified

Update readme.md, fix vocab (8192 -> 4096) (#3) 06d9b0d

Update README.md 74d1409 verified

Update README.md 5aa1cce verified

Update README.md 77bdd2a verified

Update README.md d999f97 verified

Update README.md 4d8695c verified

Create README.md 5c71983 verified

Update README.md

1a23871
verified

Update README.md

5a1a8f5
verified

Update README.md

bf1bea9
verified

Update README.md

cc38ce4
verified

Update README.md

5c33dbd
verified

Update readme.md, fix vocab (8192 -> 4096) (#3)

06d9b0d

Update README.md

74d1409
verified

Update README.md

5aa1cce
verified

Update README.md

77bdd2a
verified

Update README.md

d999f97
verified

Update README.md

4d8695c
verified

Create README.md

5c71983
verified