Update README.md
Browse files
README.md
CHANGED
|
@@ -11,45 +11,16 @@ language:
|
|
| 11 |
- ru
|
| 12 |
- ko
|
| 13 |
license: wtfpl
|
| 14 |
-
tags:
|
| 15 |
-
- heretic
|
| 16 |
-
- uncensored
|
| 17 |
-
- decensored
|
| 18 |
-
- abliterated
|
| 19 |
-
- transformers
|
| 20 |
base_model:
|
| 21 |
- mistralai/Mistral-Large-Instruct-2411
|
| 22 |
pipeline_tag: text-generation
|
| 23 |
library_name: transformers
|
| 24 |
---
|
| 25 |
|
| 26 |
-

|
| 27 |
|
| 28 |
---
|
| 29 |
-
# This is a
|
| 30 |
-
|
| 31 |
-
## Abliteration parameters
|
| 32 |
-
|
| 33 |
-
| Parameter | Value |
|
| 34 |
-
| :-------- | :---: |
|
| 35 |
-
| **direction_index** | 37.86 |
|
| 36 |
-
| **attn.o_proj.max_weight** | 1.27 |
|
| 37 |
-
| **attn.o_proj.max_weight_position** | 64.44 |
|
| 38 |
-
| **attn.o_proj.min_weight** | 1.26 |
|
| 39 |
-
| **attn.o_proj.min_weight_distance** | 47.53 |
|
| 40 |
-
| **mlp.down_proj.max_weight** | 1.44 |
|
| 41 |
-
| **mlp.down_proj.max_weight_position** | 61.73 |
|
| 42 |
-
| **mlp.down_proj.min_weight** | 1.38 |
|
| 43 |
-
| **mlp.down_proj.min_weight_distance** | 46.10 |
|
| 44 |
-
|
| 45 |
-
## Performance
|
| 46 |
-
|
| 47 |
-
| Metric | This model | Original model ([mistralai/Mistral-Large-Instruct-2411](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411)) |
|
| 48 |
-
| :----- | :--------: | :---------------------------: |
|
| 49 |
-
| **KL divergence** | 0.0578 | 0 *(by definition)* |
|
| 50 |
-
| **Refusals** | 2/100 | 87/100 |
|
| 51 |
-
|
| 52 |
-
-----
|
| 53 |
|
| 54 |
|
| 55 |
# Model Card for Mistral-Large-Instruct-2411
|
|
|
|
| 11 |
- ru
|
| 12 |
- ko
|
| 13 |
license: wtfpl
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
base_model:
|
| 15 |
- mistralai/Mistral-Large-Instruct-2411
|
| 16 |
pipeline_tag: text-generation
|
| 17 |
library_name: transformers
|
| 18 |
---
|
| 19 |
|
|
|
|
| 20 |
|
| 21 |
---
|
| 22 |
+
# This is a opti version of [mistralai/Mistral-Large-Instruct-2411](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411), made using [Heretic](https://github.com/p-e-w/heretic) v1.2.0
|
| 23 |
+
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 24 |
|
| 25 |
|
| 26 |
# Model Card for Mistral-Large-Instruct-2411
|