facebook_opt-1.3b W4A4 (lambda_factor=2, seed=1)
This repo contains the final_model checkpoint exported from:
/nfs/sloanlab007/projects/foundationmodelevaluation-mazumder_proj/quantization_ryan/facebook_opt-1.3b/W4A4/lambda_factor_2/seed_1/final_model
Quantization
- weight_bits: 4
- act_bits: 4
- weight_quant: per_channel
- act_quant: per_token
Metrics (if available)
| split | dense ppl | fakequant ppl |
|---|---|---|
| wikitext-103 test | n/a | n/a |
| lambada validation | n/a | n/a |
- Downloads last month
- 4