Instructions to use WangYe007/Test with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use WangYe007/Test with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("OneThink/OneThinker-8B") model = PeftModel.from_pretrained(base_model, "WangYe007/Test") - Transformers
How to use WangYe007/Test with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="WangYe007/Test") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("WangYe007/Test", dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use WangYe007/Test with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "WangYe007/Test" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "WangYe007/Test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/WangYe007/Test
- SGLang
How to use WangYe007/Test with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "WangYe007/Test" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "WangYe007/Test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "WangYe007/Test" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "WangYe007/Test", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use WangYe007/Test with Docker Model Runner:
docker model run hf.co/WangYe007/Test
Upload folder using huggingface_hub
Browse files- adapter_model.safetensors +1 -1
- global_step10719/bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt +3 -0
- global_step10719/bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt +3 -0
- global_step10719/bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt +3 -0
- global_step10719/bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt +3 -0
- global_step10719/bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt +3 -0
- global_step10719/bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt +3 -0
- global_step10719/bf16_zero_pp_rank_6_mp_rank_00_optim_states.pt +3 -0
- global_step10719/bf16_zero_pp_rank_7_mp_rank_00_optim_states.pt +3 -0
- global_step10719/zero_pp_rank_0_mp_rank_00_model_states.pt +3 -0
- global_step10719/zero_pp_rank_1_mp_rank_00_model_states.pt +3 -0
- global_step10719/zero_pp_rank_2_mp_rank_00_model_states.pt +3 -0
- global_step10719/zero_pp_rank_3_mp_rank_00_model_states.pt +3 -0
- global_step10719/zero_pp_rank_4_mp_rank_00_model_states.pt +3 -0
- global_step10719/zero_pp_rank_5_mp_rank_00_model_states.pt +3 -0
- global_step10719/zero_pp_rank_6_mp_rank_00_model_states.pt +3 -0
- global_step10719/zero_pp_rank_7_mp_rank_00_model_states.pt +3 -0
- latest +1 -1
- rng_state_0.pth +1 -1
- rng_state_1.pth +1 -1
- rng_state_2.pth +1 -1
- rng_state_3.pth +1 -1
- rng_state_4.pth +1 -1
- rng_state_5.pth +1 -1
- rng_state_6.pth +1 -1
- rng_state_7.pth +1 -1
- scheduler.pt +1 -1
- trainer_state.json +0 -0
adapter_model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 356134936
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7397e73255105bc2c7bc13570ab54269fa18ae943b0037e668ec36ed4de88dc0
|
| 3 |
size 356134936
|
global_step10719/bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c7c6e4287f0b31e6fd8ff8129bc619b33c0751499b2c37f11cb5612faf0528cb
|
| 3 |
+
size 267047173
|
global_step10719/bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:71e6aa66e7cac44c5b5f20eb8258b9a20e244575abe5a4889674e323dbf1fe9a
|
| 3 |
+
size 267047173
|
global_step10719/bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:734c46c2dc4678374da1870094155cd8364a45127099a4aa844c257080c92946
|
| 3 |
+
size 267047173
|
global_step10719/bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cec390bb27d0e61d124d7010a5b49d635dd128a7cbe456334c52dcabe3adaa73
|
| 3 |
+
size 267047173
|
global_step10719/bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cb64440d85f3a0057627e0db66d7af092466d35972e9355197522cfb23058bb3
|
| 3 |
+
size 267047173
|
global_step10719/bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f089aa33115e5bc5cbb616b4b80a085b0b8c315b54d6772e883a83a0f8668957
|
| 3 |
+
size 267047173
|
global_step10719/bf16_zero_pp_rank_6_mp_rank_00_optim_states.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bdc7c6b94b1ecf9aa0eb52c0962909a43c63a2cdeb767127bb24b95193ffffc0
|
| 3 |
+
size 267047173
|
global_step10719/bf16_zero_pp_rank_7_mp_rank_00_optim_states.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c76f349e251522f3010c1bf5db3416b7f7a6792776e6939dd81563a9b5a6f8a9
|
| 3 |
+
size 267047173
|
global_step10719/zero_pp_rank_0_mp_rank_00_model_states.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5db155e2785d063cfba277654cfab7c33d256b91fb5575556c6237219c8e9691
|
| 3 |
+
size 599277
|
global_step10719/zero_pp_rank_1_mp_rank_00_model_states.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ccbab3840fc672f15bd72d193d4235f0c42758717cfc1571d64a00928a424aa7
|
| 3 |
+
size 599277
|
global_step10719/zero_pp_rank_2_mp_rank_00_model_states.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7d4081031273e3d5ebdd040ddc688c18fe002404cbba96d6e84ce096fb3f87fd
|
| 3 |
+
size 599277
|
global_step10719/zero_pp_rank_3_mp_rank_00_model_states.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:304f9323dd99093663b8b315633908b4db509bfa4561b1511e0af5a698e9e0a2
|
| 3 |
+
size 599277
|
global_step10719/zero_pp_rank_4_mp_rank_00_model_states.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f478278ea303ff107d528bee75fe3005237da12be987769056ba97fc084723b2
|
| 3 |
+
size 599277
|
global_step10719/zero_pp_rank_5_mp_rank_00_model_states.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a4e31624624bfb5a0a8deceb2758369d798afbe39cc74133c76267cabcd21d98
|
| 3 |
+
size 599277
|
global_step10719/zero_pp_rank_6_mp_rank_00_model_states.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d18c569792abf2e78b054bf8a5781dc2d0fbbcb0061659e3d986500bab844be3
|
| 3 |
+
size 599277
|
global_step10719/zero_pp_rank_7_mp_rank_00_model_states.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f0ec3172726d77e84e0e490fa1633239c3fdffcd335a166ab4872881453f246d
|
| 3 |
+
size 599277
|
latest
CHANGED
|
@@ -1 +1 @@
|
|
| 1 |
-
|
|
|
|
| 1 |
+
global_step10719
|
rng_state_0.pth
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 16389
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:97e10d5d8f1d5e79af7b6bd0d6840a71542f872b087fc8fadeff3c6de6e5cf84
|
| 3 |
size 16389
|
rng_state_1.pth
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 16389
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bc97dc7fa5359820afab483a23a9a51929d39d36e9efc55b982685a40f8fc59b
|
| 3 |
size 16389
|
rng_state_2.pth
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 16389
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6539084172b40f3179a0839cb2de8004c0671dc1b89200147f9ddd6a49cc4ed6
|
| 3 |
size 16389
|
rng_state_3.pth
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 16389
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:94578e820e2792d386a32cbda0bb1aa25feb760bd98091c11e3cdafe184632d3
|
| 3 |
size 16389
|
rng_state_4.pth
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 16389
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a9253be60a49ed1ecb63f38f51188f2c593e1b1bd2e27fac6f8fc7a4aa5eb15d
|
| 3 |
size 16389
|
rng_state_5.pth
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 16389
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4b7bfa677068374d7bb239b9d337bd6a839476919b6e36396f6b27c3ad75fdfa
|
| 3 |
size 16389
|
rng_state_6.pth
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 16389
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:781933f125b567b5fd1c7b32a73a63c9892c7ba3143c65df9c5a7261594742b2
|
| 3 |
size 16389
|
rng_state_7.pth
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 16389
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:68e004345df6c35c19f0b5c390af67682530bff338dfbc55546d5884307993d2
|
| 3 |
size 16389
|
scheduler.pt
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1465
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b59a6467ce714b482dd46fc573012602d1799e37c36884f74031e36d49d59460
|
| 3 |
size 1465
|
trainer_state.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|