Text Generation
Transformers
TensorBoard
Safetensors
gpt_neox
Generated from Trainer
trl
sft
text-generation-inference
Instructions to use chardizard/Pythia410mRE-WILD with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use chardizard/Pythia410mRE-WILD with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="chardizard/Pythia410mRE-WILD")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("chardizard/Pythia410mRE-WILD") model = AutoModelForCausalLM.from_pretrained("chardizard/Pythia410mRE-WILD") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use chardizard/Pythia410mRE-WILD with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "chardizard/Pythia410mRE-WILD" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "chardizard/Pythia410mRE-WILD", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/chardizard/Pythia410mRE-WILD
- SGLang
How to use chardizard/Pythia410mRE-WILD with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "chardizard/Pythia410mRE-WILD" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "chardizard/Pythia410mRE-WILD", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "chardizard/Pythia410mRE-WILD" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "chardizard/Pythia410mRE-WILD", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use chardizard/Pythia410mRE-WILD with Docker Model Runner:
docker model run hf.co/chardizard/Pythia410mRE-WILD
| Log file created at: 2025/05/06 22:32:22 | |
| Running on machine: 4155cade5eda | |
| Binary: Built on Dec 31 1969 16:00:00 -0800 (0) | |
| Binary: Built at redacted@redacted:. | |
| Binary: Built with gc go1.25-20250420-RC00 cl/749505989 +c893e1cf82 X:fieldtrack,boringcrypto for linux/amd64 | |
| Previous log: <none> | |
| Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg | |
| E0506 22:32:22.690723 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/__init__.py" was never opened | |
| E0506 22:32:22.691960 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/drive.py" was never opened | |
| E0506 22:32:22.692515 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/_import_hooks/__init__.py" was never opened | |
| E0506 22:32:22.692587 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/_import_magics.py" was never opened | |
| E0506 22:32:22.692656 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/_installation_commands.py" was never opened | |
| E0506 22:32:22.692695 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/_interactive_table_hint_button.py" was never opened | |
| E0506 22:32:22.692794 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/_reprs.py" was never opened | |
| E0506 22:32:22.692881 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/_shell_customizations.py" was never opened | |
| E0506 22:32:22.692969 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/_system_commands.py" was never opened | |
| E0506 22:32:22.693000 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/_tensorflow_magics.py" was never opened | |
| E0506 22:32:22.693066 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/auth.py" was never opened | |
| E0506 22:32:22.693097 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/autoviz.py" was never opened | |
| E0506 22:32:22.693164 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/data_table.py" was never opened | |
| E0506 22:32:22.693197 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/files.py" was never opened | |
| E0506 22:32:22.693260 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/output/__init__.py" was never opened | |
| E0506 22:32:22.693288 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/runtime.py" was never opened | |
| E0506 22:32:22.693360 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/snippets.py" was never opened | |
| E0506 22:32:22.693389 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/widgets/__init__.py" was never opened | |
| E0506 22:32:22.693462 16 ls.go:393] document "file:///datalab/web/pyright/typeshed-fallback/stdlib/signal.pyi" was never opened | |
| E0506 22:32:22.693493 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/_message.py" was never opened | |
| E0506 22:32:22.693570 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/pexpect/popen_spawn.py" was never opened | |
| E0506 22:32:22.693597 16 ls.go:393] document "file:///datalab/web/pyright/typeshed-fallback/stubs/psutil/psutil/__init__.pyi" was never opened | |
| E0506 22:32:22.693670 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/_ipython.py" was never opened | |
| E0506 22:32:22.693698 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/google/colab/errors.py" was never opened | |
| E0506 22:32:22.693770 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/zmq/__init__.pyi" was never opened | |
| E0506 22:32:22.693814 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/zmq/backend/__init__.pyi" was never opened | |
| E0506 22:32:22.693978 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/zmq/sugar/__init__.pyi" was never opened | |
| E0506 22:32:22.694055 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/zmq/constants.py" was never opened | |
| E0506 22:32:22.694122 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/zmq/error.py" was never opened | |
| E0506 22:32:22.694151 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/zmq/sugar/attrsettr.py" was never opened | |
| E0506 22:32:22.694209 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/zmq/sugar/context.py" was never opened | |
| E0506 22:32:22.694240 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/zmq/sugar/frame.py" was never opened | |
| E0506 22:32:22.694298 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/zmq/sugar/poll.py" was never opened | |
| E0506 22:32:22.694321 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/zmq/sugar/socket.py" was never opened | |
| E0506 22:32:22.694420 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/zmq/sugar/stopwatch.py" was never opened | |
| E0506 22:32:22.694489 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/zmq/sugar/tracker.py" was never opened | |
| E0506 22:32:22.694556 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/zmq/sugar/version.py" was never opened | |
| E0506 22:32:22.694590 16 ls.go:393] document "file:///datalab/web/pyright/typeshed-fallback/stdlib/errno.pyi" was never opened | |
| E0506 22:32:22.694653 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/zmq/utils/interop.py" was never opened | |
| E0506 22:32:22.694690 16 ls.go:393] document "file:///datalab/web/pyright/typeshed-fallback/stdlib/random.pyi" was never opened | |
| E0506 22:32:22.694750 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/zmq/_typing.py" was never opened | |
| E0506 22:32:22.694779 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/zmq/utils/__init__.py" was never opened | |
| E0506 22:32:22.694946 16 ls.go:393] document "file:///usr/local/lib/python3.11/dist-packages/zmq/utils/jsonapi.py" was never opened | |