dvruette

/

gidd-mask-3b

like 0

I'm running the quick start example : https://huggingface.co/dvruette/gidd-mask-3b#quick-start

And this is what I get, is it normal?

>>> generated_ids = model.generate(
...     inputs=inputs,
...     max_length=128,
...     block_length=128,
...     steps=256,
...     sampling_method="adaptive",
...     temperature=0.0,
...     show_progress=True,
... )
100%|█████████████████████████████████| 256/256 [00:00<00:00, 271.95it/s]
>>> print(tokenizer.batch_decode(generated_ids, skip_special_tokens=False)[0])
<|begin_of_text|> In a shocking finding , scientist discovered a herd of unicorns living in a remote , previously unexplored valley , in the Andes Mountains . Even more surprising to the researchers was the fact that the unicorns spoke perfect English .<|begin_of_text|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|><|mask|>