onnx-community

/

Qwen3.5-0.8B-ONNX

like 21

Follow

ONNX Community 1.81k

HI there 👋 This is supported in Transformers.js v4.0.0-next.5

You can install with

npm i @huggingface/transformers@next

Unfortunately 4.0.0-next.5 version also throws the error

installHook.js:1 Error initializing model: Error: Unsupported model type: qwen3_5
    at async Promise.all (:3000/index 1)
    at async initializeModel (index.ts:30:12)

when I try to run

// Model configuration
const MODEL_ID = "onnx-community/Qwen3.5-0.8B-ONNX";

/**
 * Initialize the model
 */
async function initializeModel() {
  try {
    statusText.textContent = "Initializing model...";

    // Create text generation pipeline
    pipe = await pipeline('text-generation', MODEL_ID);

...

I have also tried other tasks instead of text-generation but no luck

Ah I see, that is the issue.

The models aren't currently supported by the text-generation pipeline (because technically they support image input too... but we could be supporting this better).

I have updated the model card with sample code. Basically copied from https://github.com/huggingface/transformers.js/pull/1551, which shows usage with the underlying classes.

Thanks!