Hugging Face's logo

ut-enyac
/
Llama-3.1-8B-uniql-1.0-masked-lora-rft-w4a16

Safetensors
llama
Model card Files
xet
 Community
1

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

UniQL: Unified Quantization and Low-rank Compression for Adaptive Edge LLMs

Downloads last month
2
Safetensors
Model size
65.9M params
Tensor type
I32
·
F16
·
U8
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including ut-enyac/Llama-3.1-8B-uniql-1.0-masked-lora-rft-w4a16

Paper for ut-enyac/Llama-3.1-8B-uniql-1.0-masked-lora-rft-w4a16