Instructions to use internlm/Intern-S2-Preview with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use internlm/Intern-S2-Preview with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="internlm/Intern-S2-Preview", trust_remote_code=True)
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoModelForImageTextToText
model = AutoModelForImageTextToText.from_pretrained("internlm/Intern-S2-Preview", trust_remote_code=True, dtype="auto")

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use internlm/Intern-S2-Preview with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "internlm/Intern-S2-Preview"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "internlm/Intern-S2-Preview",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/internlm/Intern-S2-Preview

SGLang

How to use internlm/Intern-S2-Preview with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "internlm/Intern-S2-Preview" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "internlm/Intern-S2-Preview",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "internlm/Intern-S2-Preview" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "internlm/Intern-S2-Preview",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use internlm/Intern-S2-Preview with Docker Model Runner:
```
docker model run hf.co/internlm/Intern-S2-Preview
```

yehaochen commited on 7 days ago

Commit

f66c559

1 Parent(s): 3332dd3

[Feature] Update time series weight

Browse files

Files changed (24) hide show

model-00001-of-00023.safetensors +3 -0
model-00002-of-00023.safetensors +3 -0
model-00003-of-00023.safetensors +3 -0
model-00004-of-00023.safetensors +3 -0
model-00005-of-00023.safetensors +3 -0
model-00006-of-00023.safetensors +3 -0
model-00007-of-00023.safetensors +3 -0
model-00008-of-00023.safetensors +3 -0
model-00009-of-00023.safetensors +3 -0
model-00010-of-00023.safetensors +3 -0
model-00011-of-00023.safetensors +3 -0
model-00012-of-00023.safetensors +3 -0
model-00013-of-00023.safetensors +3 -0
model-00014-of-00023.safetensors +3 -0
model-00015-of-00023.safetensors +3 -0
model-00016-of-00023.safetensors +3 -0
model-00017-of-00023.safetensors +3 -0
model-00018-of-00023.safetensors +3 -0
model-00019-of-00023.safetensors +3 -0
model-00020-of-00023.safetensors +3 -0
model-00021-of-00023.safetensors +3 -0
model-00022-of-00023.safetensors +3 -0
model-00023-of-00023.safetensors +3 -0
model.safetensors.index.json +0 -0

model-00001-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:995a45fa3692bd35364745a7b96acdaa631a6c3ffb8a4102edfcbf39229ac5af
+size 3920272400

model-00002-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0c629deac2d23507b1b324096a42f61129f815f2e52621f82e5365fe585580fa
+size 3357898400

model-00003-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:063764d67002b7e6bb21c0937dbe4ed90a0355cab570c878a33411ded935bea6
+size 3370808760

model-00004-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:50dd6754c2c07aa914817ead2ec53699d8f8b9f1405665d814566281c1951043
+size 3357898400

model-00005-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e7bcd4ca7a6eb1c349170c00858a52e526268b0b305590124e20543750ba1669
+size 3370808760

model-00006-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a6b0c9c45273dac6f35d61ddf45f4b27a5e81203adda07d677f53680f46c89c3
+size 3357898360

model-00007-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9aa57c51a4742dc646e060a9047b8daf12911f69dd4cc7ff98dfb1d32912a24f
+size 3370808792

model-00008-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:37c11f3eb529963a1a9c7511a4aeddb45d6182363a42f9dd6b144e0c3f9114b6
+size 3357898432

model-00009-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:78728fb1a8ca22a82f6f293cd3bda71e712cd17dd5b55ad8746d7e317aacafa4
+size 3370808792

model-00010-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:455404e35f8e0c488eb08196fe27568a13f9f4b36268039d8f37572149a500ef
+size 3357898432

model-00011-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ef470a402662cf45b36d8b12e7dcea6192ff9de7612bd60829410e40e9a4084e
+size 3370808792

model-00012-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9490b4f09f2420deeb254209fa68cdc9339860560d26037ef3b56bc1733b39eb
+size 3357898432

model-00013-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ccb516812b38f42c775f7b6681496129d49f88f3d6874d7ff101580fe0073ab2
+size 3370808792

model-00014-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:779b5ee835558166adb60e1e187bf44c1a862b693f94a4a4fec2d59a463be0d9
+size 3357898432

model-00015-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:18575d53b0c3708ffbbb14a2e9008a1fa0ec426887ab547ba765e3325436dbdd
+size 3370808792

model-00016-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0e24ce8453b89b8fb6a390358080250d6a6dd60b3190984d7ac9e920711ae33c
+size 3357898432

model-00017-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e8020324419f3ad5f03812594d6ee152c5a869c71077230649321aaf5a76bd9b
+size 3370808792

model-00018-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6f3f9808fd16522e225e30bf1654c366de9827dd9261cbf5bf2bdf6a5b944232
+size 3357898432

model-00019-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:64ca6cea07284e2d43ec4fb32e78941b9e505178d3e870891449bf0b73e2f281
+size 3370808792

model-00020-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bd30d6f3db1c81b3ce74e994aa0604781218d8f307203130d768d967428f5b5b
+size 3357898432

model-00021-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b725bd593e946e8242f9e8585f4f7b53c4f6ba1795244f45b9a0ca458714b232
+size 4288914488

model-00022-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b609eeea1d0fcbdd1a5fd9d2979f5c4b331caa4fef49432c096795db90ae1ddd
+size 833287792

model-00023-of-00023.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ba1b2ece7654c0af7d58eccf467b5fc2f4d5627a047731935a64727bf6e421c9
+size 272854528

model.safetensors.index.json CHANGED Viewed

The diff for this file is too large to render. See raw diff