Hugging Face's logo

Harley-ml
/
Dillion-1.2M

Text Generation
Transformers
Safetensors
PyTorch
English
qwen3_5_text
dillion
small
harley-ml
Model card Files
xet
 Community
1
Harley-ml commited on
Commit
7f2e698
·
verified ·
1 Parent(s): 26dcbd4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -108,10 +108,10 @@ We trained Dillion for 0.71 epochs on 14B (only saw ~9B) tokens of FineWeb-edu o
108
 
109
  | Task | Metric | Dillion | SupraMini-v4-2M | Tenete-8M |
110
  | -------- | --------------- | -------: | --------------: | ---------: |
111
- | ARC Easy | acc_norm | 31.36% | — | 0.3194 |
112
  | BLiMP | acc | 62.94% | 60.70% | — |
113
- | PiQA | acc_norm | 53.10% | 51.90% | 0.5571 |
114
- | SWAG | acc_norm | 30.36% | — | 0.3297 |
115
  | WikiText | bits_per_byte | 1.6161 | — | — |
116
  | WikiText | byte_perplexity | 3.0655 | 3.1652 | — |
117
 
 
108
 
109
  | Task | Metric | Dillion | SupraMini-v4-2M | Tenete-8M |
110
  | -------- | --------------- | -------: | --------------: | ---------: |
111
+ | ARC Easy | acc_norm | 31.36% | — | 31.94% |
112
  | BLiMP | acc | 62.94% | 60.70% | — |
113
+ | PiQA | acc_norm | 53.10% | 51.90% | 55.71% |
114
+ | SWAG | acc_norm | 30.36% | — | 32.97% |
115
  | WikiText | bits_per_byte | 1.6161 | — | — |
116
  | WikiText | byte_perplexity | 3.0655 | 3.1652 | — |
117