Hugging Face's logo

GreenBitAI
/
Qwen-1.5-7B-Chat-layer-mix-bpw-2.2

Text Generation
Transformers
Safetensors
qwen2
conversational
text-generation-inference
Model card Files
xet
 Community

GreenBit LLMs

This is GreenBitAI's pretrained low-bit LLMs with extreme compression yet still strong performance.

Please refer to our Github page for the code to run the model and more information.

Downloads last month
1
Safetensors
Model size
2B params
Tensor type
I32
·
F16
·
I16
·
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including GreenBitAI/Qwen-1.5-7B-Chat-layer-mix-bpw-2.2