facebook_opt-1.3b W6A6 (lambda_factor=50, seed=1)
This repo contains the final_model checkpoint exported from:
/nfs/sloanlab007/projects/foundationmodelevaluation-mazumder_proj/quantization_ryan/facebook_opt-1.3b/W6A6/lambda_factor_50/seed_1/final_model
Quantization
- weight_bits: 6
- act_bits: 6
- weight_quant: per_channel
- act_quant: per_token
Metrics (if available)
| split | dense ppl | fakequant ppl |
|---|---|---|
| wikitext-103 test | n/a | n/a |
| lambada validation | n/a | n/a |
- Downloads last month
- 4