Hugging Face's logo

lmstudio-community
/
Mistral-Small-4-119B-2603-GGUF

GGUF
conversational
Model card Files
xet
 Community
1

Strange output / <SPECIAL_31>

#1
by florianstrasser - opened
Discussion
florianstrasser

When trying to run the new model I get the most annoying output I have seen yet :D

<SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31><SPECIAL_31>

image
florianstrasser

I'm quite annoyed that no one else is complaining about this, does it work for others?
dimwap
•
edited 21 days ago

It's better to ask the model itself such questions; it knows its own structure best. Take a look at the tokenizer.json - This symbol clearly comes from there. The table has a special space reserved for token 31. Something happened during training or conversion. Perhaps this token was in the training examples, but it's not present in the template. idk - ask Google AI. It has five explanation:

  1. Tokenizer Mismatch
  2. Stop Token Error
  3. Corrupted Weights
  4. Quantization Issues
  5. check if the library version (e.g., transformers)
florianstrasser

Interesting... Thanks for your explanations

Sign up or log in to comment