Instructions to use Zyphra/ZAYA1-VL-8B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Zyphra/ZAYA1-VL-8B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="Zyphra/ZAYA1-VL-8B")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoModelForSeq2SeqLM
model = AutoModelForSeq2SeqLM.from_pretrained("Zyphra/ZAYA1-VL-8B", dtype="auto")

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use Zyphra/ZAYA1-VL-8B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Zyphra/ZAYA1-VL-8B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Zyphra/ZAYA1-VL-8B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/Zyphra/ZAYA1-VL-8B

SGLang

How to use Zyphra/ZAYA1-VL-8B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Zyphra/ZAYA1-VL-8B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Zyphra/ZAYA1-VL-8B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Zyphra/ZAYA1-VL-8B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Zyphra/ZAYA1-VL-8B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use Zyphra/ZAYA1-VL-8B with Docker Model Runner:
```
docker model run hf.co/Zyphra/ZAYA1-VL-8B
```

ZAYA1-VL-8B

Commit History

Update README.md

9084f2e
verified

hassansh commited on about 6 hours ago

Update README.md

91c194b
verified

hassansh commited on 1 day ago

Add paper and code links, and library metadata (#2)

b1e3d47

kasra-h

nielsr HF Staff commited on 2 days ago

Update README.md

7cdfbe6
verified

hassansh commited on 8 days ago

Update README.md

bb1586f
verified

kasra-h commited on 8 days ago

Update README.md

7fc2381
verified

hassansh commited on 8 days ago

Update README.md

69740a1
verified

ganeshnanduru commited on 8 days ago

Update README.md

4496a06
verified

ganeshnanduru commited on 8 days ago

Update README.md

135c613
verified

ganeshnanduru commited on 8 days ago

Update README.md

4c58090
verified

ganeshnanduru commited on 8 days ago

Update README.md

699b0b7
verified

hassansh commited on 8 days ago

Update README.md

b238cb2
verified

hassansh commited on 8 days ago

Update config.json

fda6d21
verified

ganeshnanduru commited on 8 days ago

Upload folder using huggingface_hub

769048c
verified

ganeshnanduru commited on 8 days ago

Update README.md

c9b5c11
verified

BerenMillidge commited on 8 days ago

Update README.md

8e1eb70
verified

hassansh commited on 8 days ago

Update README.md

5d68d1b
verified

hassansh commited on 8 days ago

Update README.md

d8ecf06
verified

BerenMillidge commited on 8 days ago

Update README.md

57e279b
verified

hassansh commited on 8 days ago

Update README.md

d9b3d7e
verified

BerenMillidge commited on 8 days ago

Update README.md

1cc7562
verified

hassansh commited on 8 days ago

Update README.md

48171d6
verified

hassansh commited on 8 days ago

Update README.md

d99ffdb
verified

hassansh commited on 8 days ago

Update README.md

90eaeb1
verified

hassansh commited on 8 days ago

Update README.md

7299986
verified

hassansh commited on 8 days ago

Update README.md

311c5a2
verified

hassansh commited on 8 days ago

Update README.md

b7861a7
verified

hassansh commited on 10 days ago

Update README.md

4cfe0bd
verified

hassansh commited on 10 days ago

Update README.md

daa240d
verified

hassansh commited on 10 days ago

Update README.md

e9b74a6
verified

hassansh commited on 10 days ago

Update README.md

845e2f2
verified

hassansh commited on 11 days ago

Update README.md

0f9229b
verified

BerenMillidge commited on 26 days ago

Update README.md

1017c26
verified

BerenMillidge commited on 26 days ago

initial commit

3a0bcbe
verified

BerenMillidge commited on 27 days ago

Commit History

Update README.md 9084f2e verified

Update README.md 91c194b verified

Add paper and code links, and library metadata (#2) b1e3d47

Update README.md 7cdfbe6 verified

Update README.md bb1586f verified

Update README.md 7fc2381 verified

Update README.md 69740a1 verified

Update README.md 4496a06 verified

Update README.md 135c613 verified

Update README.md 4c58090 verified

Update README.md 699b0b7 verified

Update README.md b238cb2 verified

Update config.json fda6d21 verified

Upload folder using huggingface_hub 769048c verified

Update README.md c9b5c11 verified

Update README.md 8e1eb70 verified

Update README.md 5d68d1b verified

Update README.md d8ecf06 verified

Update README.md 57e279b verified

Update README.md d9b3d7e verified

Update README.md 1cc7562 verified

Update README.md 48171d6 verified

Update README.md d99ffdb verified

Update README.md 90eaeb1 verified

Update README.md 7299986 verified

Update README.md 311c5a2 verified

Update README.md b7861a7 verified

Update README.md 4cfe0bd verified

Update README.md daa240d verified

Update README.md e9b74a6 verified

Update README.md 845e2f2 verified

Update README.md 0f9229b verified

Update README.md 1017c26 verified

initial commit 3a0bcbe verified

Update README.md

9084f2e
verified

Update README.md

91c194b
verified

Add paper and code links, and library metadata (#2)

b1e3d47

Update README.md

7cdfbe6
verified

Update README.md

bb1586f
verified

Update README.md

7fc2381
verified

Update README.md

69740a1
verified

Update README.md

4496a06
verified

Update README.md

135c613
verified

Update README.md

4c58090
verified

Update README.md

699b0b7
verified

Update README.md

b238cb2
verified

Update config.json

fda6d21
verified

Upload folder using huggingface_hub

769048c
verified

Update README.md

c9b5c11
verified

Update README.md

8e1eb70
verified

Update README.md

5d68d1b
verified

Update README.md

d8ecf06
verified

Update README.md

57e279b
verified

Update README.md

d9b3d7e
verified

Update README.md

1cc7562
verified

Update README.md

48171d6
verified

Update README.md

d99ffdb
verified

Update README.md

90eaeb1
verified

Update README.md

7299986
verified

Update README.md

311c5a2
verified

Update README.md

b7861a7
verified

Update README.md

4cfe0bd
verified

Update README.md

daa240d
verified

Update README.md

e9b74a6
verified

Update README.md

845e2f2
verified

Update README.md

0f9229b
verified

Update README.md

1017c26
verified

initial commit

3a0bcbe
verified