Instructions to use FrontiersMind/Nandi-Mini-150M with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use FrontiersMind/Nandi-Mini-150M with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="FrontiersMind/Nandi-Mini-150M", trust_remote_code=True)

# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("FrontiersMind/Nandi-Mini-150M", trust_remote_code=True, dtype="auto")

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use FrontiersMind/Nandi-Mini-150M with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "FrontiersMind/Nandi-Mini-150M"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "FrontiersMind/Nandi-Mini-150M",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/FrontiersMind/Nandi-Mini-150M

SGLang

How to use FrontiersMind/Nandi-Mini-150M with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "FrontiersMind/Nandi-Mini-150M" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "FrontiersMind/Nandi-Mini-150M",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "FrontiersMind/Nandi-Mini-150M" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "FrontiersMind/Nandi-Mini-150M",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use FrontiersMind/Nandi-Mini-150M with Docker Model Runner:
```
docker model run hf.co/FrontiersMind/Nandi-Mini-150M
```

Nandi-Mini-150M

Commit History

Update README.md

31c8ace
verified

vishesh-t27 commited on 7 days ago

Update tokenization_nandi.py

c5d242d
verified

vishesh-t27 commited on 7 days ago

Update tokenization_nandi.py

138e620
verified

vishesh-t27 commited on 7 days ago

Update tokenization_nandi.py

42aa86f
verified

vishesh-t27 commited on 7 days ago

Update tokenization_nandi.py

00f4956
verified

vishesh-t27 commited on 7 days ago

Update README.md

e253817
verified

vishesh-t27 commited on 7 days ago

updated model name and socials

a9b1918
verified

vishesh-t27 commited on 30 days ago

model name change

a8e570f
verified

vishesh-t27 commited on 30 days ago

Update README.md

c9a3136
verified

vishesh-t27 commited on Apr 17

Update README.md

50c699e
verified

vishesh-t27 commited on Apr 14

Updated readme.md

3e217be
verified

vishesh-t27 commited on Apr 13

updated Readme.md

c6a866f
verified

vishesh-t27 commited on Apr 4

Update README.md

4cbe55e
verified

vishesh-t27 commited on Apr 4

Update config.json

f039894
verified

aksinghyaani commited on Apr 3

Update README.md

ce6f0d8
verified

vishesh-t27 commited on Apr 3

Update README.md

347c056
verified

vishesh-t27 commited on Apr 2

Update README.md

b32f4a7
verified

vishesh-t27 commited on Apr 2

added tokenizer's fertility score in Readme

6c4fbcc
verified

vishesh-t27 commited on Apr 2

Update README.md

655e347
verified

aksinghyaani commited on Apr 2

Update README.md

94122b8
verified

aksinghyaani commited on Apr 2

Update README.md

4bf161d
verified

aksinghyaani commited on Apr 2

Update README.md

459a8eb
verified

aksinghyaani commited on Apr 2

Update README.md

63c78ab
verified

vishesh-t27 commited on Apr 2

Update config.json

6b1adf1
verified

vishesh-t27 commited on Apr 2

Update README.md

532c9bd
verified

vishesh-t27 commited on Apr 2

Update README.md

2e8c58c
verified

vishesh-t27 commited on Apr 2

Update tokenization_nandi.py

e3827cb
verified

vishesh-t27 commited on Apr 2

Update tokenization_nandi.py

bdf2e42
verified

vishesh-t27 commited on Apr 2

Update README.md

ba4702b
verified

vishesh-t27 commited on Apr 2

Update README.md

28cf1ca
verified

vishesh-t27 commited on Apr 2

updated Readme.md

7bee726
verified

vishesh-t27 commited on Apr 2

updated readme.md

f5213b6
verified

vishesh-t27 commited on Apr 2

updated Readme.md

4331f85
verified

vishesh-t27 commited on Apr 2

updated readme.md

39d4144
verified

vishesh-t27 commited on Apr 2

updated readme.md

aa593c0
verified

vishesh-t27 commited on Apr 1

updated readme.md

94a8490
verified

vishesh-t27 commited on Apr 1

Update README.md

523221e
verified

HemanthSai7 commited on Apr 1

Upload model.safetensors

5666639
verified

HemanthSai7 commited on Apr 1

Delete model.safetensors

9a9e359
verified

HemanthSai7 commited on Apr 1

Update tokenizer_config.json

ecf9385
verified

HemanthSai7 commited on Apr 1

Update tokenization_nandi.py

bf277cf
verified

HemanthSai7 commited on Apr 1

Update modeling_nandi.py

feaca64
verified

HemanthSai7 commited on Apr 1

Update modeling_nandi.py

04e5e05
verified

HemanthSai7 commited on Apr 1

Update tokenization_nandi.py

61f43f8
verified

HemanthSai7 commited on Apr 1

Update modeling_nandi.py

5512fbc
verified

HemanthSai7 commited on Apr 1

Update tokenization_nandi.py

4204a26
verified

HemanthSai7 commited on Apr 1

Create README.md

ce6bf00
verified

HemanthSai7 commited on Apr 1

Update configuration_nandi.py

d61c78e
verified

HemanthSai7 commited on Apr 1

Fix NandiModel.forward: add cache_position for compatibility with released transformers 5.3.0

8fde181
verified

HemanthSai7 commited on Apr 1

Fix configuration_nandi.py: use init instead of @strict /__post_init__ for compatibility with released transformers

094f4e0
verified

HemanthSai7 commited on Apr 1

Commit History

Update README.md 31c8ace verified

Update tokenization_nandi.py c5d242d verified

Update tokenization_nandi.py 138e620 verified

Update tokenization_nandi.py 42aa86f verified

Update tokenization_nandi.py 00f4956 verified

Update README.md e253817 verified

updated model name and socials a9b1918 verified

model name change a8e570f verified

Update README.md c9a3136 verified

Update README.md 50c699e verified

Updated readme.md 3e217be verified

updated Readme.md c6a866f verified

Update README.md 4cbe55e verified

Update config.json f039894 verified

Update README.md ce6f0d8 verified

Update README.md 347c056 verified

Update README.md b32f4a7 verified

added tokenizer's fertility score in Readme 6c4fbcc verified

Update README.md 655e347 verified

Update README.md 94122b8 verified

Update README.md 4bf161d verified

Update README.md 459a8eb verified

Update README.md 63c78ab verified

Update config.json 6b1adf1 verified

Update README.md 532c9bd verified

Update README.md 2e8c58c verified

Update tokenization_nandi.py e3827cb verified

Update tokenization_nandi.py bdf2e42 verified

Update README.md ba4702b verified

Update README.md 28cf1ca verified

updated Readme.md 7bee726 verified

updated readme.md f5213b6 verified

updated Readme.md 4331f85 verified

updated readme.md 39d4144 verified

updated readme.md aa593c0 verified

updated readme.md 94a8490 verified

Update README.md 523221e verified

Upload model.safetensors 5666639 verified

Delete model.safetensors 9a9e359 verified

Update tokenizer_config.json ecf9385 verified

Update tokenization_nandi.py bf277cf verified

Update modeling_nandi.py feaca64 verified

Update modeling_nandi.py 04e5e05 verified

Update tokenization_nandi.py 61f43f8 verified

Update modeling_nandi.py 5512fbc verified

Update tokenization_nandi.py 4204a26 verified

Create README.md ce6bf00 verified

Update configuration_nandi.py d61c78e verified

Fix NandiModel.forward: add cache_position for compatibility with released transformers 5.3.0 8fde181 verified

Fix configuration_nandi.py: use __init__ instead of @strict /__post_init__ for compatibility with released transformers 094f4e0 verified

Update README.md

31c8ace
verified

Update tokenization_nandi.py

c5d242d
verified

Update tokenization_nandi.py

138e620
verified

Update tokenization_nandi.py

42aa86f
verified

Update tokenization_nandi.py

00f4956
verified

Update README.md

e253817
verified

updated model name and socials

a9b1918
verified

model name change

a8e570f
verified

Update README.md

c9a3136
verified

Update README.md

50c699e
verified

Updated readme.md

3e217be
verified

updated Readme.md

c6a866f
verified

Update README.md

4cbe55e
verified

Update config.json

f039894
verified

Update README.md

ce6f0d8
verified

Update README.md

347c056
verified

Update README.md

b32f4a7
verified

added tokenizer's fertility score in Readme

6c4fbcc
verified

Update README.md

655e347
verified

Update README.md

94122b8
verified

Update README.md

4bf161d
verified

Update README.md

459a8eb
verified

Update README.md

63c78ab
verified

Update config.json

6b1adf1
verified

Update README.md

532c9bd
verified

Update README.md

2e8c58c
verified

Update tokenization_nandi.py

e3827cb
verified

Update tokenization_nandi.py

bdf2e42
verified

Update README.md

ba4702b
verified

Update README.md

28cf1ca
verified

updated Readme.md

7bee726
verified

updated readme.md

f5213b6
verified

updated Readme.md

4331f85
verified

updated readme.md

39d4144
verified

updated readme.md

aa593c0
verified

updated readme.md

94a8490
verified

Update README.md

523221e
verified

Upload model.safetensors

5666639
verified

Delete model.safetensors

9a9e359
verified

Update tokenizer_config.json

ecf9385
verified

Update tokenization_nandi.py

bf277cf
verified

Update modeling_nandi.py

feaca64
verified

Update modeling_nandi.py

04e5e05
verified

Update tokenization_nandi.py

61f43f8
verified

Update modeling_nandi.py

5512fbc
verified

Update tokenization_nandi.py

4204a26
verified

Create README.md

ce6bf00
verified

Update configuration_nandi.py

d61c78e
verified

Fix NandiModel.forward: add cache_position for compatibility with released transformers 5.3.0

8fde181
verified

Fix configuration_nandi.py: use init instead of @strict /__post_init__ for compatibility with released transformers

094f4e0
verified