YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
# TheBlueObserver/Llama-3.2-3B-Instruct__huatuo-r128-a128-epoch3-Merged-q4_k_m-gguf
This is a GGUF quantized version (Q4_K_M) of the original model TheBlueObserver/Llama-3.2-3B-Instruct__huatuo-r128-a128-epoch3-Merged.
## Quantization Details
- Original Model: TheBlueObserver/Llama-3.2-3B-Instruct__huatuo-r128-a128-epoch3-Merged
- Quantization Type: Q4_K_M
- File Format: GGUF
- Downloads last month
- 5
Hardware compatibility
Log In to add your hardware
4-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support