Hugging Face's logo

HuggingFaceBio
/
Carbon-8B

Text Generation
Transformers
Safetensors
Upper Grand Valley Dani
llama
genomic
text-generation-inference
Model card Files
xet
 Community
1
loubnabnl HF Staff commited on
Commit
000ed11
·
verified ·
1 Parent(s): 9cb7d0e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -71,10 +71,10 @@ Genome-NIAH measures how well a DNA model actually *uses* its long context. See
71
 
72
  | Context length | Carbon 3B (native / YaRN 4×) | Carbon 8B (native / YaRN 4×) | Evo2 7B |
73
  |------------------------|------------------------------|------------------------------|---------|
74
- | 16 k tokens (98 kbp) | 0.73 / 0.91 | 0.78 / 0.89 | 0.97 |
75
- | 32 k tokens (196 kbp) | 0.55 / 0.90 | 0.69 / 0.87 | 0.95 |
76
- | 64 k tokens (393 kbp) | — / 0.79 | — / 0.86 | 0.80 |
77
- | 128 k tokens (786 kbp) | — / 0.27 | — / 0.65 | *running* |
78
 
79
  Carbon-8B retrieves reliably up to its 32 k native boundary; **YaRN 4×** recovers most of the loss at the 32 k → 64 k boundary and extends usable retrieval to ≈ 786 kbp.
80
 
 
71
 
72
  | Context length | Carbon 3B (native / YaRN 4×) | Carbon 8B (native / YaRN 4×) | Evo2 7B |
73
  |------------------------|------------------------------|------------------------------|---------|
74
+ | 16 k tokens (98 kbp) | 0.73 / 0.91 | 0.78 / 0.89 | **0.97** |
75
+ | 32 k tokens (196 kbp) | 0.55 / 0.90 | 0.69 / 0.87 | **0.95** |
76
+ | 64 k tokens (393 kbp) | — / 0.79 | — / **0.86** | 0.80 |
77
+ | 128 k tokens (786 kbp) | — / 0.27 | — / **0.65** | 0.53 |
78
 
79
  Carbon-8B retrieves reliably up to its 32 k native boundary; **YaRN 4×** recovers most of the loss at the 32 k → 64 k boundary and extends usable retrieval to ≈ 786 kbp.
80