This model is converted from zai-org/GLM-OCR to GGUF using convert_hf_to_gguf.py
convert_hf_to_gguf.py
To use it:
llama-server -hf ggml-org/GLM-OCR-GGUF
Chat template
8-bit
16-bit
Base model