Text Generation
Transformers
TensorBoard
Safetensors
gpt_neox
Generated from Trainer
trl
sft
text-generation-inference
Instructions to use chardizard/DyTPythia410mRE-WILD with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use chardizard/DyTPythia410mRE-WILD with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="chardizard/DyTPythia410mRE-WILD")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("chardizard/DyTPythia410mRE-WILD") model = AutoModelForCausalLM.from_pretrained("chardizard/DyTPythia410mRE-WILD") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use chardizard/DyTPythia410mRE-WILD with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "chardizard/DyTPythia410mRE-WILD" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "chardizard/DyTPythia410mRE-WILD", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/chardizard/DyTPythia410mRE-WILD
- SGLang
How to use chardizard/DyTPythia410mRE-WILD with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "chardizard/DyTPythia410mRE-WILD" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "chardizard/DyTPythia410mRE-WILD", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "chardizard/DyTPythia410mRE-WILD" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "chardizard/DyTPythia410mRE-WILD", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use chardizard/DyTPythia410mRE-WILD with Docker Model Runner:
docker model run hf.co/chardizard/DyTPythia410mRE-WILD
| Log file created at: 2025/05/06 22:33:43 | |
| Running on machine: 4155cade5eda | |
| Binary: Built on Dec 31 1969 16:00:00 -0800 (0) | |
| Binary: Built at redacted@redacted:. | |
| Binary: Built with gc go1.25-20250420-RC00 cl/749505989 +c893e1cf82 X:fieldtrack,boringcrypto for linux/amd64 | |
| Previous log: <none> | |
| Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg | |
| I0506 22:33:43.489595 1 log_spam.go:43] Process id 1064 | |
| I0506 22:33:43.490186 1 log_spam.go:47] Current working directory /datalab/web | |
| I0506 22:33:43.490200 1 log_spam.go:49] Current timezone is UTC (currently UTC +00:00) | |
| I0506 22:33:43.490236 1 log_spam.go:50] Built on Dec 31 1969 16:00:00 -0800 (0) | |
| at redacted@redacted:. | |
| as //research/colab/datalab/language_service:language_service | |
| with gc go1.25-20250420-RC00 cl/749505989 +c893e1cf82 X:fieldtrack,boringcrypto for linux/amd64 | |
| from changelist 0 in a unknown client based on redacted | |
| Build tool: unknown | |
| Build target: //research/colab/datalab/language_service:language_service | |
| Build id: unknown | |
| Built with PGO profile: unknown | |
| I0506 22:33:43.490242 1 log_spam.go:51] Command line arguments: | |
| I0506 22:33:43.490245 1 log_spam.go:53] argv[0]: '/usr/colab/bin/language_service' | |
| I0506 22:33:43.490248 1 log_spam.go:53] argv[1]: '--lsp_search_dirs=/datalab/web/pyright/typeshed-fallback/stdlib,/usr/local/lib/python3.10/dist-packages' | |
| I0506 22:33:43.490250 1 log_spam.go:53] argv[2]: '--language_services_request_root_url=http://172.28.0.1:8013/' | |
| I0506 22:33:43.490253 1 log_spam.go:53] argv[3]: '--language_services_request_timeout=30s' | |
| I0506 22:33:43.490254 1 log_spam.go:53] argv[4]: '--' | |
| I0506 22:33:43.490261 1 log_spam.go:53] argv[5]: 'node' | |
| I0506 22:33:43.490263 1 log_spam.go:53] argv[6]: '/datalab/web/pyright/pyright-langserver.js' | |
| I0506 22:33:43.490265 1 log_spam.go:53] argv[7]: '--stdio' | |
| I0506 22:33:43.490268 1 log_spam.go:53] argv[8]: '--cancellationReceive=file:7150a16a70f89d7143b386c2e17776bdff58fac4c3' | |
| I0506 22:34:12.586462 57 ls.go:1241] cancel was requested for: 11, needs to be canceled: false | |
| I0506 22:34:42.784394 57 ls.go:1241] cancel was requested for: 15, needs to be canceled: false | |
| I0506 22:34:43.380436 57 ls.go:1241] cancel was requested for: 17, needs to be canceled: false | |
| I0506 22:36:07.608816 57 ls.go:1241] cancel was requested for: 44, needs to be canceled: false | |
| I0507 05:05:29.275791 57 ls.go:1241] cancel was requested for: 60, needs to be canceled: false | |
| I0507 19:39:53.706461 57 ls.go:1241] cancel was requested for: 81, needs to be canceled: false | |
| I0507 19:40:28.299059 57 ls.go:1241] cancel was requested for: 89, needs to be canceled: false | |
| I0507 19:40:30.745681 57 ls.go:1241] cancel was requested for: 92, needs to be canceled: false | |
| I0507 19:40:30.919793 57 ls.go:1241] cancel was requested for: 94, needs to be canceled: false | |
| I0507 19:40:31.076445 57 ls.go:1241] cancel was requested for: 95, needs to be canceled: false | |
| I0507 19:40:31.282715 57 ls.go:1241] cancel was requested for: 96, needs to be canceled: false | |
| I0507 19:40:37.900437 57 ls.go:1241] cancel was requested for: 105, needs to be canceled: false | |
| I0507 19:40:38.394575 57 ls.go:1241] cancel was requested for: 106, needs to be canceled: false | |
| I0507 19:40:40.145283 57 ls.go:1241] cancel was requested for: 108, needs to be canceled: false | |
| I0507 19:40:40.288871 57 ls.go:1241] cancel was requested for: 112, needs to be canceled: false | |
| I0507 19:40:42.224335 57 ls.go:1241] cancel was requested for: 113, needs to be canceled: false | |
| I0507 19:40:44.067914 57 ls.go:1241] cancel was requested for: 116, needs to be canceled: false | |
| I0507 19:40:44.068078 57 ls.go:1241] cancel was requested for: 114, needs to be canceled: false | |
| I0507 19:40:55.104885 57 ls.go:1241] cancel was requested for: 119, needs to be canceled: false | |
| I0507 19:42:45.266892 57 ls.go:1241] cancel was requested for: 154, needs to be canceled: false | |
| I0507 19:42:45.538553 57 ls.go:1241] cancel was requested for: 155, needs to be canceled: false | |
| I0507 19:42:49.266402 57 ls.go:1241] cancel was requested for: 157, needs to be canceled: false | |
| I0507 19:43:19.120050 57 ls.go:1241] cancel was requested for: 163, needs to be canceled: false | |
| I0507 19:43:48.560869 57 ls.go:1241] cancel was requested for: 179, needs to be canceled: false | |
| I0507 19:43:50.369343 57 ls.go:1241] cancel was requested for: 180, needs to be canceled: false | |
| I0507 19:46:58.974167 57 ls.go:1241] cancel was requested for: 205, needs to be canceled: false | |
| I0507 19:57:30.842196 57 ls.go:1241] cancel was requested for: 227, needs to be canceled: false | |
| I0507 19:57:32.606158 57 ls.go:1241] cancel was requested for: 233, needs to be canceled: false | |
| I0507 19:57:33.517055 57 ls.go:1241] cancel was requested for: 237, needs to be canceled: false | |
| I0507 19:57:36.161698 57 ls.go:1241] cancel was requested for: 244, needs to be canceled: false | |
| I0507 19:57:37.110992 57 ls.go:1241] cancel was requested for: 247, needs to be canceled: false | |
| I0507 19:57:37.398904 57 ls.go:1241] cancel was requested for: 248, needs to be canceled: false | |
| I0507 19:57:37.904089 57 ls.go:1241] cancel was requested for: 245, needs to be canceled: false | |
| I0507 19:57:53.230593 57 ls.go:1241] cancel was requested for: 257, needs to be canceled: false | |
| I0507 19:58:49.516393 57 ls.go:1241] cancel was requested for: 261, needs to be canceled: false | |
| I0507 19:58:49.807308 57 ls.go:1241] cancel was requested for: 262, needs to be canceled: false | |
| I0507 19:58:50.005121 57 ls.go:1241] cancel was requested for: 263, needs to be canceled: false | |
| I0507 19:58:53.205900 57 ls.go:1241] cancel was requested for: 267, needs to be canceled: false | |
| I0507 20:02:36.976390 57 ls.go:1241] cancel was requested for: 268, needs to be canceled: false | |
| I0507 20:02:48.736851 57 ls.go:1241] cancel was requested for: 270, needs to be canceled: false | |
| I0507 20:02:55.572059 57 ls.go:1241] cancel was requested for: 273, needs to be canceled: false | |
| I0507 20:02:55.863069 57 ls.go:1241] cancel was requested for: 274, needs to be canceled: false | |
| I0507 20:02:59.343362 57 ls.go:1241] cancel was requested for: 280, needs to be canceled: false | |