Agnuxo
/

Mistral-Nemo-CODE-Python_assistant_16bit

Text Generation

code-generation-assistant

scientific-research

Model card Files Files and versions

Agnuxo commited on Aug 26, 2024

Commit

c7c6f23

·

verified ·

1 Parent(s): dcce4bd

Upload tokenizer

Files changed (1) hide show

tokenizer_config.json +1 -1

tokenizer_config.json CHANGED Viewed

@@ -8007,7 +8007,7 @@
   "bos_token": "<s>",
   "clean_up_tokenization_spaces": false,
   "eos_token": "</s>",
-  "model_max_length": 1000000000000000019884624838656,
   "pad_token": "<pad>",
   "padding_side": "left",
   "tokenizer_class": "PreTrainedTokenizerFast",

   "bos_token": "<s>",
   "clean_up_tokenization_spaces": false,
   "eos_token": "</s>",
+  "model_max_length": 1024000,
   "pad_token": "<pad>",
   "padding_side": "left",
   "tokenizer_class": "PreTrainedTokenizerFast",