?????? outputs with image inputs
#1
by AI-Joe-git - opened
Hello! First of all, thanks for this new quant. I’ve been testing MMJPro, but I’m getting '??????' outputs when using image inputs with both the 4B and 9B models.
I'm also unable to obtain anything meaningful with image analysis from the 4B model (original Qwen doing fine though ...) using latest llama.cpp server
I'm also unable to obtain anything meaningful with image analysis from the 4B model (original Qwen doing fine though ...) using latest llama.cpp server
I found a workaround: use --no-mmproj-offload and it will work. If it still doesn't, try using --reasoning-budget 512.
wow TOP! thx!