Quantized LFM2.5
Collection
Verified models. Compatible with vLLM. • 14 items • Updated • 1
This is LFM2.5-1.2B-Thinking quantized with AutoRound to GGUF, mixing different precisions.
Several versions (higher bpw is better and bigger):
- 3 average bits per weight (bpw)
- 4 bpw
- 5 bpw
Tested with LM Studio.
- Developed by: The Kaitchup
- License: lfm1.0
- Downloads last month
- 41
Hardware compatibility
Log In to add your hardware
We're not able to determine the quantization variants.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for kaitchup/LFM2.5-1.2B-Thinking-1.2B-autoround-gguf
Base model
LiquidAI/LFM2.5-1.2B-Base Finetuned
LiquidAI/LFM2.5-1.2B-Thinking