Carbon-3B / dna_config.json
kashif's picture
kashif HF Staff
Fix tokenizer: EOS bug + decode skip_special_tokens=True empty string (#1)
f47e012
raw
history blame contribute delete
160 Bytes
{
"k": 6,
"dna_start_id": 151669,
"dna_vocab_size": 4107,
"dna_special_tokens": [
"<dna>",
"</dna>",
"<oov>"
],
"auto_dna_tags": false
}