OLMo-2-1124-7B-Instruct parity Q8_0 GGUF
This repository contains a same-origin GGUF export of allenai/OLMo-2-1124-7B-Instruct prepared for local parity testing in mesh-llm.
Artifact:
olmo2-7b-instruct-q8_0.gguf
Notes:
- converted locally from the cached origin checkpoint
- quantized to
Q8_0 - intended to pair with
meshllm/olmo2-7b-instruct-parity-8bit-mlx - exact validation passed locally on 2026-04-07
Source model:
- Downloads last month
- 9
Hardware compatibility
Log In to add your hardware
8-bit
Model tree for meshllm/olmo2-7b-instruct-parity-q8_0-gguf
Base model
allenai/OLMo-2-1124-7B Finetuned
allenai/OLMo-2-1124-7B-SFT Finetuned
allenai/OLMo-2-1124-7B-DPO Finetuned
allenai/OLMo-2-1124-7B-Instruct