Instructions to use inclusionAI/Ring-2.6-1T with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use inclusionAI/Ring-2.6-1T with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="inclusionAI/Ring-2.6-1T", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("inclusionAI/Ring-2.6-1T", trust_remote_code=True, dtype="auto")

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use inclusionAI/Ring-2.6-1T with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "inclusionAI/Ring-2.6-1T"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "inclusionAI/Ring-2.6-1T",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/inclusionAI/Ring-2.6-1T

SGLang

How to use inclusionAI/Ring-2.6-1T with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "inclusionAI/Ring-2.6-1T" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "inclusionAI/Ring-2.6-1T",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "inclusionAI/Ring-2.6-1T" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "inclusionAI/Ring-2.6-1T",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use inclusionAI/Ring-2.6-1T with Docker Model Runner:
```
docker model run hf.co/inclusionAI/Ring-2.6-1T
```

xiaoyayaya commited on 6 days ago

Commit

3bca051

verified ·

1 Parent(s): 52408d8

Add files using upload-large-folder tool

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

.gitattributes +1 -0
model-00004-of-00175.safetensors +3 -0
model-00009-of-00175.safetensors +3 -0
model-00011-of-00175.safetensors +3 -0
model-00019-of-00175.safetensors +3 -0
model-00020-of-00175.safetensors +3 -0
model-00021-of-00175.safetensors +3 -0
model-00023-of-00175.safetensors +3 -0
model-00025-of-00175.safetensors +3 -0
model-00029-of-00175.safetensors +3 -0
model-00033-of-00175.safetensors +3 -0
model-00039-of-00175.safetensors +3 -0
model-00043-of-00175.safetensors +3 -0
model-00047-of-00175.safetensors +3 -0
model-00050-of-00175.safetensors +3 -0
model-00054-of-00175.safetensors +3 -0
model-00056-of-00175.safetensors +3 -0
model-00063-of-00175.safetensors +3 -0
model-00065-of-00175.safetensors +3 -0
model-00072-of-00175.safetensors +3 -0
model-00074-of-00175.safetensors +3 -0
model-00077-of-00175.safetensors +3 -0
model-00079-of-00175.safetensors +3 -0
model-00086-of-00175.safetensors +3 -0
model-00088-of-00175.safetensors +3 -0
model-00092-of-00175.safetensors +3 -0
model-00095-of-00175.safetensors +3 -0
model-00097-of-00175.safetensors +3 -0
model-00099-of-00175.safetensors +3 -0
model-00100-of-00175.safetensors +3 -0
model-00101-of-00175.safetensors +3 -0
model-00106-of-00175.safetensors +3 -0
model-00108-of-00175.safetensors +3 -0
model-00113-of-00175.safetensors +3 -0
model-00115-of-00175.safetensors +3 -0
model-00124-of-00175.safetensors +3 -0
model-00126-of-00175.safetensors +3 -0
model-00128-of-00175.safetensors +3 -0
model-00133-of-00175.safetensors +3 -0
model-00140-of-00175.safetensors +3 -0
model-00149-of-00175.safetensors +3 -0
model-00152-of-00175.safetensors +3 -0
model-00155-of-00175.safetensors +3 -0
model-00158-of-00175.safetensors +3 -0
model-00160-of-00175.safetensors +3 -0
model-00162-of-00175.safetensors +3 -0
model-00163-of-00175.safetensors +3 -0
model-00164-of-00175.safetensors +3 -0
model-00167-of-00175.safetensors +3 -0
model-00170-of-00175.safetensors +3 -0

.gitattributes CHANGED Viewed

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text

 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+model.safetensors.index.json filter=lfs diff=lfs merge=lfs -text

model-00004-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1cf530bf9bc2f280e02fe27ae96f296a7a87bcee118d914a49f09dd9b180d7ca
+size 8592159664

model-00009-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9372b139c1a86c9f45026fcb0328b9912517c725c97d151af046de453c23c3a7
+size 8592159664

model-00011-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:dc1150460d37a158d8a6503c9019c8d0d429445d5088ca1ab41f1eb81633190f
+size 8592159664

model-00019-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5394d1a9c987d1f51b020cb530176ede0a59645f32fe30707558ec37dad87f42
+size 4299226144

model-00020-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d7a216af80cdd636ba6ae3d145ec02622d449523858188186870769b5709a624
+size 8592159664

model-00021-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a9439f206b28d2ac3ecdae621abb7b4e8d07087405623799b0ba538b64067a9d
+size 5341826712

model-00023-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:38b7e8d8812c141f9078314e7278f14c13e9bda305460e6fd66326a032384434
+size 8592158640

model-00025-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6ebc1ec1f2519cfef2b7ec902b5a01127421ddd9cc819d2c472d7e4ca2dd6e3f
+size 8592158640

model-00029-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a41871714a127b4edb5bc346996f1cdd42d4c7b93ff1829ca883c160ae8d9dc2
+size 8592159664

model-00033-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1eb89993dedeef72c6cea340b1273e3b31844f29beeb3fc6725c828294cec0dd
+size 4500601672

model-00039-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a6a8b6c5a5f2ae86c531d3134810e571f718fb4d21bd41500851effedc70c090
+size 5373232624

model-00043-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cb5bde923cbf3b822d7c6d8e3c0d503802f736d17b0a953458da33b8e61ce80b
+size 8592159664

model-00047-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a7200b65d80108ce8d78622d922e5169edf76a39df0a9fa544b8b46dbe700146
+size 8592159664

model-00050-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b7c492388e5d86ac77158dabbfc4c304e0057c9423f7eaff93b0ae6412f7b8c3
+size 8592159664

model-00054-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:38a9c440ec4219f06b93ffc57166909ca62b113d843643c4ea53698986cee2c4
+size 8592159664

model-00056-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f87b0e2c7ece07a91fef12f5d0b344742b01262c4862d169f4aadb79661dff1a
+size 8592159664

model-00063-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e3fef8e33a2dcd54df3878882b0140e2a965e758fe1147df9adb889af7209df6
+size 8592159664

model-00065-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7cd0f14a0b8fd4134b5ed27da436a561c834256eb2c1751628f26cb88adbb0c6
+size 8592159664

model-00072-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5c556ca99c1d536532805db09e848e3aff50ad3cf522e5b1e76b1673b52ab171
+size 8592159664

model-00074-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:086b35d592ad52163a4861052de58ed8473c739cb29907752521d69217428f9d
+size 8592159664

model-00077-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:63aee2d0718343925bc4c804d3988251d2099d72b542040ae47b13082c546cd5
+size 8592159664

model-00079-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:efa880939be4dae530b727f19d9177874f3f22f4129fbb3c2e2ceb83e83e96c3
+size 8592159664

model-00086-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:df41bfcc52c3384b548c1a656b67cfce8ceb43f6ef8dee309b53545baf8be61c
+size 8592159664

model-00088-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ee2629b24d3627e24ce4ea3d1e5ca5b28a7e0fcb381e16a2746ac5e723c44d2b
+size 8592159664

model-00092-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f8458e73c8a03cb270c60996d8ce27c103cc08261e038f359056fcc9b224eb7b
+size 8592159664

model-00095-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cb10e4d348f24d221c611d9791fcd7a98c45778c4ac298fc0f405f5c7ec4ec54
+size 8592159664

model-00097-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5ba3300841839b48f5b2752ec4a432c476aecb1e105727b5c97a1bde7809b3b9
+size 8592159664

model-00099-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a3bfaa772c34e84ed7c7c97b1456dc07956292d99705e2f42575af945b1b3bb7
+size 8592159664

model-00100-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:59a64d350bf8889a17b463e41ca3ca9fa95c7d531043ee9f00b0b13e4b85a022
+size 4299226144

model-00101-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:71f52e11717fc239f7979301e21d810d7d60cc5469025a201cd0bb25ebcd48aa
+size 8592159664

model-00106-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2f2b25cf04ba4527baf09acf1d92a3270fea066d864bbc394c1f2884ad57ab98
+size 8592159664

model-00108-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e0f1d856e00a91b74f0e2e834efbb1b5c81789547c797f3c87c0c54b3c849dd1
+size 8592159664

model-00113-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d860dc3b94218119dab2b174da68219bd22508c5c86d4033a102272e86315640
+size 8592159664

model-00115-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6f9437667e244ff9c235cada4239e611a9c69832e25d5d80e2318b3f353a40d5
+size 8592159664

model-00124-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1d3e933b97b4713a3bce52fadf3df2f4741b1c1f45ec7ea6f78ebbf9a511fab3
+size 8592159664

model-00126-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8cf424d8a60a14bafbee8b96d51a631cc73e15f45350e24e5aa36f5f31fde4bf
+size 8592159664

model-00128-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a34cbd08921bb364bdaea1ee5fa8e2b8097fbb96d6a22e963b377ee68c4c13f6
+size 8592159664

model-00133-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:42d686534651b543247fd69600f143467a9e397c9020f14b95811d3cf79cf955
+size 8592159664

model-00140-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:607a8fa1d357250a2aef1cebaa16c615b61df8b0da365eb0968ba8e9032dae86
+size 8592159664

model-00149-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6af2705abd143f51f124c41627a4b8a5b47a1d043643a411ba734d32f453ac2f
+size 8592159664

model-00152-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7bc918b2dfae01fa2b8b7a93fd62bb43820131c2c38d8de4d590076c92ff749e
+size 4299226144

model-00155-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9a329727f749ed7145e894ff9d3190234f5062adf650b38cbe4bb3c5debf089b
+size 8592159664

model-00158-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:315db43bb16e6c49f2b4947072653104743e15c50e97ec8aa29770d1f0b80e4b
+size 8592159664

model-00160-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c76c63bc228ddcb02f7587f8ec45f2c518c7932ec03291f5092422ddc6e7d256
+size 8592159664

model-00162-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e2cd9d7ee2a8bdfdd4373447b95fb9dc3d027da77e284e728ada2595eb350f6a
+size 8592159664

model-00163-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:51210fc9ecb67c64464d172759b0d230407799946b0755e4eb8c2f5265c7b0a1
+size 4299226144

model-00164-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f441050ae08f7872f0095e792d71c7e9bff33e949cc49173c845869506fbf25a
+size 8592159664

model-00167-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:86afa6ae8efeed45a7c5a344becb9178e1c7e17dd8e7532f45b3e0eef87e5821
+size 8592159664

model-00170-of-00175.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:32e00d2c4dd55193107313199859cd43bfd63f61c9542c606bcb4a642984f1df
+size 9084602568