Hugging Face's logo

ut-enyac
/
Llama-2-7b-hf-uniql-1.0-masked-lora-rft-w4a16

Safetensors
llama
Model card Files
xet
 Community
1

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

UniQL: Unified Quantization and Low-rank Compression for Adaptive Edge LLMs

Downloads last month
4
Safetensors
Model size
0.9B params
Tensor type
I32
·
F16
·
U8
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including ut-enyac/Llama-2-7b-hf-uniql-1.0-masked-lora-rft-w4a16

Paper for ut-enyac/Llama-2-7b-hf-uniql-1.0-masked-lora-rft-w4a16