Model Failed to Load. (Linux arm64, CUDA 12.6 on NVIDIA GB10 Blackwell GPU)

#1
by SourBNulink - opened

I Installed Nexa-AI using:

curl -fsSL https://github.com/NexaAI/nexa-sdk/releases/latest/download/nexa-cli_linux_arm64.sh -o install.sh && chmod +x install.sh && ./install.sh && rm install.sh

Then tried to run this model using:

nexa infer NexaAI/Qwen3-VL-2B-Instruct-GGUF

Got a model failed to load error with no further information

Sign up or log in to comment