Update README.md

README.md

@@ -1,5 +1,7 @@
 ## 模型推理方式
 
+### transformers
+
 transformers>=5.6.0
 
 ```python
@@ -35,6 +37,40 @@ response = tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:], skip_spe
 print(response)
 ```
 
+### vllm
+
+Build vLLM from source:
+```bash
+uv venv --python 3.12 --seed --managed-python
+source .venv/bin/activate
+git clone https://github.com/vllm-project/vllm.git
+cd vllm
+uv pip install --editable . --torch-backend=auto
+```
+
+Start the vLLM server:
+
+```bash
+vllm serve tencent/Hy-MT2-30B-A3B --tensor-parallel-size 1
+```
+
+### sglang
+
+Build SGLang from source:
+```bash
+git clone https://github.com/sgl-project/sglang
+cd sglang
+pip3 install pip --upgrade
+pip3 install "transformers>=5.6.0"
+pip3 install -e "python"
+```
+
+Launch SGLang server:
+
+```bash
+python3 -m sglang.launch_server --model tencent/Hy-MT2-30B-A3B --tp 1
+```
+
 ## 翻译指令推荐模板
 
 | 类型 | 模板 | 说明 |