Quant_method error
The quantization config has empty {} for every layer . config file needs updating. - i might be wrong might be something else : butbothmlx and lmstudio fail. [LLMProcess] Failed to load model _0x2d9650 [Error]: Failed to load model.
at _0x2470de.loadModel (/Applications/LM Studio.app/Contents/Resources/app/.webpack/lib/llmworker.js:1:561296)
at process.processTicksAndRejections (node:internal/process/task_queues:104:5)
at async _0x2470de.handleMessage (/Applications/LM Studio.app/Contents/Resources/app/.webpack/lib/llmworker.js:1:553295) {
cause: "Error when loading model: KeyError: 'quant_method'",
suggestion: undefined,
errorData: undefined,
data: undefined,
displayData: undefined,
title: 'Failed to load model.'
}.
+1, doesn't work with lm studio
not work Omlx
i confirm, this model does not function with either lmstudio or omlx
can try to fix it using claudecode/something else.. only config.json one file wrong.. send the file & error message to AI can fix the problem in 2~3 attempt..
Of course I asked ai, but it didn't work. Please share the file if you solved it
can try to fix it using claudecode/something else.. only config.json one file wrong.. send the file & error message to AI can fix the problem in 2~3 attempt..