YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

        # TheBlueObserver/Llama-3.2-1B-Instruct__huatuo-r128-a128-epoch2-Merged-q4_k_m-gguf
        
        This is a GGUF quantized version (Q4_K_M) of the original model TheBlueObserver/Llama-3.2-1B-Instruct__huatuo-r128-a128-epoch2-Merged.
        
        ## Quantization Details
        - Original Model: TheBlueObserver/Llama-3.2-1B-Instruct__huatuo-r128-a128-epoch2-Merged
        - Quantization Type: Q4_K_M
        - File Format: GGUF
        
Downloads last month
3
GGUF
Model size
1B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support