Qwen/Qwen3-14B W4A4 (lambda_factor=2, seed=1)
This repo contains the checkpoint exported from:
/nfs/sloanlab007/projects/foundationmodelevaluation-mazumder_proj/quantization_ryan/Qwen/Qwen3-14B/W4A4/lambda_factor_2/seed_1/hf_ckpt
Quantization
- weight_bits: 4
- act_bits: 4
- weight_quant: per_channel
- act_quant: per_token
Metrics (if available)
| split | dense ppl | fakequant ppl |
|---|---|---|
| wikitext-103 test | n/a | n/a |
| lambada validation | n/a | n/a |
- Downloads last month
- 3