Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -91,6 +91,15 @@ Best with: target OpenCL, draft CPU, d=3, thread_num=2, power=high.
|
|
| 91 |
## Usage
|
| 92 |
Download via TokForge app: Settings > Spec Decode > Download Acceleration Pack
|
| 93 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 94 |
## Version History
|
| 95 |
|
| 96 |
| Version | Samples | KL | Uplift | Date |
|
|
@@ -104,3 +113,16 @@ Download via TokForge app: Settings > Spec Decode > Download Acceleration Pack
|
|
| 104 |
**License:** Apache 2.0
|
| 105 |
**Source:** KL-distilled from [Qwen/Qwen3-0.6B](https://huggingface.co/Qwen/Qwen3-0.6B) using [Qwen/Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B) as teacher
|
| 106 |
**Built with:** [TokForge](https://tokforge.ai)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 91 |
## Usage
|
| 92 |
Download via TokForge app: Settings > Spec Decode > Download Acceleration Pack
|
| 93 |
|
| 94 |
+
### Typical TokForge recipe
|
| 95 |
+
|
| 96 |
+
- target backend: `opencl`
|
| 97 |
+
- draft backend: `cpu`
|
| 98 |
+
- draft threads: `2`
|
| 99 |
+
- `d=3`
|
| 100 |
+
- greedy sampling
|
| 101 |
+
- low precision / low memory
|
| 102 |
+
|
| 103 |
## Version History
|
| 104 |
|
| 105 |
| Version | Samples | KL | Uplift | Date |
|
|
|
|
| 113 |
**License:** Apache 2.0
|
| 114 |
**Source:** KL-distilled from [Qwen/Qwen3-0.6B](https://huggingface.co/Qwen/Qwen3-0.6B) using [Qwen/Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B) as teacher
|
| 115 |
**Built with:** [TokForge](https://tokforge.ai)
|
| 116 |
+
|
| 117 |
+
## Limitations and Intended Use
|
| 118 |
+
|
| 119 |
+
- Best current evidence is strongest on `Qwen3-8B` and `Qwen3-14B`.
|
| 120 |
+
- `Qwen3-4B` was not a strong lane in our preserved results.
|
| 121 |
+
- Device uplift depends heavily on backend routing, prompt length, and thermal state.
|
| 122 |
+
- This is a TokForge-specific runtime bundle, not a standard Transformers checkpoint.
|
| 123 |
+
|
| 124 |
+
## Community
|
| 125 |
+
|
| 126 |
+
- Website: [tokforge.ai](https://tokforge.ai)
|
| 127 |
+
- Discord: [Join the Discord](https://discord.gg/Acv3CBtfVm)
|
| 128 |
+
- Collection: [TokForge Mobile Draft Models](https://huggingface.co/collections/darkmaniac7/tokforge-mobile-draft-models-69c36153ea7084ce78329665)
|