dranger003/openbuddy-qwen1.5-14b-v20.1-32k-iMat.GGUF

• GGUF importance matrix (imatrix) quants for https://huggingface.co/OpenBuddy/openbuddy-qwen1.5-14b-v20.1-32k
• The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
• The imatrix is being used on the K-quants as well.

Layers	Context	Template
40	32768	<|im_start|>user {prompt}<|im_end|> <|im_start|>assistant {response}