GoldDiamondGold-Abliterated 70b
This is a merge of pre-trained language models created using mergekit.
Motivation
Because Original model was too censored.
Heretic Results
Abliteration parameters
| Parameter | Value |
|---|---|
| direction_index | 31.68 |
| attn.o_proj.max_weight | 1.08 |
| attn.o_proj.max_weight_position | 63.81 |
| attn.o_proj.min_weight | 0.82 |
| attn.o_proj.min_weight_distance | 43.96 |
| mlp.down_proj.max_weight | 1.18 |
| mlp.down_proj.max_weight_position | 52.18 |
| mlp.down_proj.min_weight | 0.76 |
| mlp.down_proj.min_weight_distance | 33.45 |
Performance
| Metric | This model | Original model |
|---|---|---|
| KL divergence | 0.0139 | 0 (by definition) |
| Refusals | 9/100 | 94/100 |
- Downloads last month
- 21
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support