Text Generation
Transformers
TensorBoard
Safetensors
gpt_neox
Generated from Trainer
trl
sft
text-generation-inference
Instructions to use chardizard/Pythia410mRE-WILD with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use chardizard/Pythia410mRE-WILD with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="chardizard/Pythia410mRE-WILD")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("chardizard/Pythia410mRE-WILD") model = AutoModelForCausalLM.from_pretrained("chardizard/Pythia410mRE-WILD") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use chardizard/Pythia410mRE-WILD with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "chardizard/Pythia410mRE-WILD" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "chardizard/Pythia410mRE-WILD", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/chardizard/Pythia410mRE-WILD
- SGLang
How to use chardizard/Pythia410mRE-WILD with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "chardizard/Pythia410mRE-WILD" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "chardizard/Pythia410mRE-WILD", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "chardizard/Pythia410mRE-WILD" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "chardizard/Pythia410mRE-WILD", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use chardizard/Pythia410mRE-WILD with Docker Model Runner:
docker model run hf.co/chardizard/Pythia410mRE-WILD
Training in progress, step 15500
Browse files- dap_multiplexer.INFO +9 -9
- language_service.INFO +45 -21
- model.safetensors +2 -2
- training_args.bin +1 -1
dap_multiplexer.INFO
CHANGED
|
@@ -1,14 +1,14 @@
|
|
| 1 |
-
Log file created at: 2025/05/06
|
| 2 |
-
Running on machine:
|
| 3 |
Binary: Built on Dec 31 1969 16:00:00 -0800 (0)
|
| 4 |
Binary: Built at redacted@redacted:.
|
| 5 |
Binary: Built with gc go1.25-20250420-RC00 cl/749505989 +c893e1cf82 X:fieldtrack,boringcrypto for linux/amd64
|
| 6 |
Previous log: <none>
|
| 7 |
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
|
| 8 |
-
I0506
|
| 9 |
-
I0506
|
| 10 |
-
I0506
|
| 11 |
-
I0506
|
| 12 |
at redacted@redacted:.
|
| 13 |
as //research/colab/dap_multiplexer:dap_multiplexer
|
| 14 |
with gc go1.25-20250420-RC00 cl/749505989 +c893e1cf82 X:fieldtrack,boringcrypto for linux/amd64
|
|
@@ -17,6 +17,6 @@ Build tool: unknown
|
|
| 17 |
Build target: //research/colab/dap_multiplexer:dap_multiplexer
|
| 18 |
Build id: unknown
|
| 19 |
Built with PGO profile: unknown
|
| 20 |
-
I0506
|
| 21 |
-
I0506
|
| 22 |
-
I0506
|
|
|
|
| 1 |
+
Log file created at: 2025/05/06 18:08:35
|
| 2 |
+
Running on machine: b07af655c6a1
|
| 3 |
Binary: Built on Dec 31 1969 16:00:00 -0800 (0)
|
| 4 |
Binary: Built at redacted@redacted:.
|
| 5 |
Binary: Built with gc go1.25-20250420-RC00 cl/749505989 +c893e1cf82 X:fieldtrack,boringcrypto for linux/amd64
|
| 6 |
Previous log: <none>
|
| 7 |
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
|
| 8 |
+
I0506 18:08:35.903164 1 log_spam.go:43] Process id 137
|
| 9 |
+
I0506 18:08:35.903840 1 log_spam.go:47] Current working directory /
|
| 10 |
+
I0506 18:08:35.903848 1 log_spam.go:49] Current timezone is UTC (currently UTC +00:00)
|
| 11 |
+
I0506 18:08:35.903913 1 log_spam.go:50] Built on Dec 31 1969 16:00:00 -0800 (0)
|
| 12 |
at redacted@redacted:.
|
| 13 |
as //research/colab/dap_multiplexer:dap_multiplexer
|
| 14 |
with gc go1.25-20250420-RC00 cl/749505989 +c893e1cf82 X:fieldtrack,boringcrypto for linux/amd64
|
|
|
|
| 17 |
Build target: //research/colab/dap_multiplexer:dap_multiplexer
|
| 18 |
Build id: unknown
|
| 19 |
Built with PGO profile: unknown
|
| 20 |
+
I0506 18:08:35.903922 1 log_spam.go:51] Command line arguments:
|
| 21 |
+
I0506 18:08:35.903927 1 log_spam.go:53] argv[0]: '/usr/local/bin/dap_multiplexer'
|
| 22 |
+
I0506 18:08:35.903931 1 log_spam.go:53] argv[1]: '--domain_socket_path=/tmp/debugger_1ihn10rabp'
|
language_service.INFO
CHANGED
|
@@ -1,14 +1,14 @@
|
|
| 1 |
-
Log file created at: 2025/05/06 18:
|
| 2 |
-
Running on machine:
|
| 3 |
Binary: Built on Dec 31 1969 16:00:00 -0800 (0)
|
| 4 |
Binary: Built at redacted@redacted:.
|
| 5 |
Binary: Built with gc go1.25-20250420-RC00 cl/749505989 +c893e1cf82 X:fieldtrack,boringcrypto for linux/amd64
|
| 6 |
Previous log: <none>
|
| 7 |
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
|
| 8 |
-
I0506 18:
|
| 9 |
-
I0506 18:
|
| 10 |
-
I0506 18:
|
| 11 |
-
I0506 18:
|
| 12 |
at redacted@redacted:.
|
| 13 |
as //research/colab/datalab/language_service:language_service
|
| 14 |
with gc go1.25-20250420-RC00 cl/749505989 +c893e1cf82 X:fieldtrack,boringcrypto for linux/amd64
|
|
@@ -17,18 +17,42 @@ Build tool: unknown
|
|
| 17 |
Build target: //research/colab/datalab/language_service:language_service
|
| 18 |
Build id: unknown
|
| 19 |
Built with PGO profile: unknown
|
| 20 |
-
I0506 18:
|
| 21 |
-
I0506 18:
|
| 22 |
-
I0506 18:
|
| 23 |
-
I0506 18:
|
| 24 |
-
I0506 18:
|
| 25 |
-
I0506 18:
|
| 26 |
-
I0506 18:
|
| 27 |
-
I0506 18:
|
| 28 |
-
I0506 18:
|
| 29 |
-
I0506 18:
|
| 30 |
-
I0506 18:19:
|
| 31 |
-
I0506 18:
|
| 32 |
-
I0506 18:
|
| 33 |
-
I0506
|
| 34 |
-
I0506
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Log file created at: 2025/05/06 18:19:41
|
| 2 |
+
Running on machine: b07af655c6a1
|
| 3 |
Binary: Built on Dec 31 1969 16:00:00 -0800 (0)
|
| 4 |
Binary: Built at redacted@redacted:.
|
| 5 |
Binary: Built with gc go1.25-20250420-RC00 cl/749505989 +c893e1cf82 X:fieldtrack,boringcrypto for linux/amd64
|
| 6 |
Previous log: <none>
|
| 7 |
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
|
| 8 |
+
I0506 18:19:41.717097 1 log_spam.go:43] Process id 3031
|
| 9 |
+
I0506 18:19:41.717582 1 log_spam.go:47] Current working directory /datalab/web
|
| 10 |
+
I0506 18:19:41.717595 1 log_spam.go:49] Current timezone is UTC (currently UTC +00:00)
|
| 11 |
+
I0506 18:19:41.717645 1 log_spam.go:50] Built on Dec 31 1969 16:00:00 -0800 (0)
|
| 12 |
at redacted@redacted:.
|
| 13 |
as //research/colab/datalab/language_service:language_service
|
| 14 |
with gc go1.25-20250420-RC00 cl/749505989 +c893e1cf82 X:fieldtrack,boringcrypto for linux/amd64
|
|
|
|
| 17 |
Build target: //research/colab/datalab/language_service:language_service
|
| 18 |
Build id: unknown
|
| 19 |
Built with PGO profile: unknown
|
| 20 |
+
I0506 18:19:41.717652 1 log_spam.go:51] Command line arguments:
|
| 21 |
+
I0506 18:19:41.717656 1 log_spam.go:53] argv[0]: '/usr/colab/bin/language_service'
|
| 22 |
+
I0506 18:19:41.717661 1 log_spam.go:53] argv[1]: '--lsp_search_dirs=/datalab/web/pyright/typeshed-fallback/stdlib,/usr/local/lib/python3.10/dist-packages'
|
| 23 |
+
I0506 18:19:41.717665 1 log_spam.go:53] argv[2]: '--language_services_request_root_url=http://172.28.0.1:8013/'
|
| 24 |
+
I0506 18:19:41.717668 1 log_spam.go:53] argv[3]: '--language_services_request_timeout=30s'
|
| 25 |
+
I0506 18:19:41.717671 1 log_spam.go:53] argv[4]: '--'
|
| 26 |
+
I0506 18:19:41.717682 1 log_spam.go:53] argv[5]: 'node'
|
| 27 |
+
I0506 18:19:41.717685 1 log_spam.go:53] argv[6]: '/datalab/web/pyright/pyright-langserver.js'
|
| 28 |
+
I0506 18:19:41.717688 1 log_spam.go:53] argv[7]: '--stdio'
|
| 29 |
+
I0506 18:19:41.717692 1 log_spam.go:53] argv[8]: '--cancellationReceive=file:15252db1c886861deb82a831bf172cb79d84703f3f'
|
| 30 |
+
I0506 18:19:47.753115 52 ls.go:1241] cancel was requested for: 10, needs to be canceled: false
|
| 31 |
+
I0506 18:21:52.634700 52 ls.go:1241] cancel was requested for: 15, needs to be canceled: false
|
| 32 |
+
I0506 18:21:54.200669 52 ls.go:1241] cancel was requested for: 16, needs to be canceled: false
|
| 33 |
+
I0506 18:21:54.854416 52 ls.go:1241] cancel was requested for: 17, needs to be canceled: false
|
| 34 |
+
I0506 18:22:12.179738 52 ls.go:1241] cancel was requested for: 23, needs to be canceled: false
|
| 35 |
+
I0506 18:22:12.664717 52 ls.go:1241] cancel was requested for: 25, needs to be canceled: false
|
| 36 |
+
I0506 18:22:40.269723 52 ls.go:1241] cancel was requested for: 32, needs to be canceled: false
|
| 37 |
+
I0506 18:23:27.618397 52 ls.go:1241] cancel was requested for: 54, needs to be canceled: false
|
| 38 |
+
I0506 18:23:31.491393 52 ls.go:1241] cancel was requested for: 60, needs to be canceled: false
|
| 39 |
+
I0506 18:23:40.130561 52 ls.go:1241] cancel was requested for: 67, needs to be canceled: false
|
| 40 |
+
I0506 18:23:42.525602 52 ls.go:1241] cancel was requested for: 68, needs to be canceled: false
|
| 41 |
+
I0506 18:24:04.685209 52 ls.go:1241] cancel was requested for: 86, needs to be canceled: false
|
| 42 |
+
I0506 18:24:08.577608 52 ls.go:1241] cancel was requested for: 88, needs to be canceled: false
|
| 43 |
+
I0506 18:24:09.471818 52 ls.go:1241] cancel was requested for: 89, needs to be canceled: false
|
| 44 |
+
I0506 18:24:09.783382 52 ls.go:1241] cancel was requested for: 90, needs to be canceled: false
|
| 45 |
+
I0506 18:24:13.972705 52 ls.go:1241] cancel was requested for: 94, needs to be canceled: false
|
| 46 |
+
I0506 18:24:17.720220 52 ls.go:1241] cancel was requested for: 96, needs to be canceled: false
|
| 47 |
+
I0506 18:24:20.054453 52 ls.go:1241] cancel was requested for: 97, needs to be canceled: false
|
| 48 |
+
I0506 18:24:29.919637 52 ls.go:1241] cancel was requested for: 102, needs to be canceled: false
|
| 49 |
+
I0506 18:24:30.274732 52 ls.go:1241] cancel was requested for: 103, needs to be canceled: false
|
| 50 |
+
I0506 18:24:33.118910 52 ls.go:1241] cancel was requested for: 110, needs to be canceled: false
|
| 51 |
+
I0506 18:24:33.313052 52 ls.go:1241] cancel was requested for: 111, needs to be canceled: false
|
| 52 |
+
I0506 18:24:37.702974 52 ls.go:1241] cancel was requested for: 115, needs to be canceled: false
|
| 53 |
+
I0506 18:24:46.033624 52 ls.go:1241] cancel was requested for: 120, needs to be canceled: false
|
| 54 |
+
I0506 18:24:46.628875 52 ls.go:1241] cancel was requested for: 121, needs to be canceled: false
|
| 55 |
+
I0506 18:24:46.953272 52 ls.go:1241] cancel was requested for: 122, needs to be canceled: false
|
| 56 |
+
I0506 18:24:47.636919 52 ls.go:1241] cancel was requested for: 123, needs to be canceled: false
|
| 57 |
+
I0506 18:27:52.393660 52 ls.go:1241] cancel was requested for: 139, needs to be canceled: false
|
| 58 |
+
I0506 18:27:59.676321 52 ls.go:1241] cancel was requested for: 143, needs to be canceled: false
|
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2cb314001e4a9162b08f02e1bca9f3a1da5f991073b1273b4a774c5f3b03d56e
|
| 3 |
+
size 1621375948
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 5624
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:40e360dd6496ec917b8d06dbf50496f10b40e7a0c2bdc1cef254b784d703ca12
|
| 3 |
size 5624
|