Model Failed to Load. (Linux arm64, CUDA 12.6 on NVIDIA GB10 Blackwell GPU)
#1
by SourBNulink - opened
I Installed Nexa-AI using:
curl -fsSL https://github.com/NexaAI/nexa-sdk/releases/latest/download/nexa-cli_linux_arm64.sh -o install.sh && chmod +x install.sh && ./install.sh && rm install.sh
Then tried to run this model using:
nexa infer NexaAI/Qwen3-VL-2B-Instruct-GGUF
Got a model failed to load error with no further information