RedHatAI

/

Qwen3-8B-speculator.eagle3

like 28

Follow

Red Hat AI 2.24k

Is this draft model supported only on vLLM? on SGLang, it throws a config mismatch error:

["config.json does not have 'model_type'"](ValueError: Unrecognized model in RedHatAI/Qwen3-8B-speculator.eagle3.
Should have a model_type key in its config.json)