Update README.md
Browse files
README.md
CHANGED
|
@@ -74,7 +74,6 @@ pip install "transformers @ git+https://github.com/Zyphra/transformers.git@zaya1
|
|
| 74 |
To start vLLM server, run the following command:
|
| 75 |
```bash
|
| 76 |
vllm serve Zyphra/Zaya1-8B --port 8010 \
|
| 77 |
-
--max-model-len 131072 --max-num-seqs 256 --gpu-memory-utilization 0.9 \
|
| 78 |
--mamba-cache-dtype float32 --dtype bfloat16 \
|
| 79 |
--reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser zaya_xml
|
| 80 |
```
|
|
|
|
| 74 |
To start vLLM server, run the following command:
|
| 75 |
```bash
|
| 76 |
vllm serve Zyphra/Zaya1-8B --port 8010 \
|
|
|
|
| 77 |
--mamba-cache-dtype float32 --dtype bfloat16 \
|
| 78 |
--reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser zaya_xml
|
| 79 |
```
|