This is a Gemma-The-Writer-9B fine-tune, produced through P-E-W's Heretic (v1.1.0) abliteration engine merged with the Magnitude-Preserving Orthogonal Ablation PR.

Note: This model was generated at the request of redaihf.

Heretication Results

Score Metric	Value	Parameter	Value
Refusals	5/100	direction_index	23.56
KL Divergence	0.1650	attn.o_proj.max_weight	1.74
Initial Refusals	98/100	attn.o_proj.max_weight_position	34.98
		attn.o_proj.min_weight	0.31
		attn.o_proj.min_weight_distance	23.75
		mlp.down_proj.max_weight	1.83
		mlp.down_proj.max_weight_position	36.27
		mlp.down_proj.min_weight	0.99
		mlp.down_proj.min_weight_distance	23.08

Degree of Heretication

The Heresy Index weighs the resulting model's corruption by the process (KL Divergence) and its abolition of doctrine (Refusals) for a final verdict in classification.

Index Entry	Classification	Analysis
	Absolute Heresy	Less than 10/100 Refusals and 0.10 KL Divergence
	Tainted Heresy	Around 25-11/100 Refusals and/or -0.20-0.11 KL Divergence
	Impotent Heresy	Anything above 25/100 Refusals and 0.21 KL Divergence

Note: This is an arbitrary classification inspired by Warhammer 40K, having no tangible indication towards the model's performance.

Gemma-The-Writer-9B

This repo contains the full precision source code, in "safe tensors" format to generate GGUFs, GPTQ, EXL2, AWQ, HQQ and other formats. The source code can also be used directly.

IMPORTANT: Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers

If you are going to use this model, (source, GGUF or a different quant), please review this document for critical parameter, sampler and advance sampler settings (for multiple AI/LLM aps).

This a "Class 1" (settings will enhance operation) model:

For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) (especially for use case(s) beyond the model's design) please see:

[ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]

REASON:

Regardless of "model class" this document will detail methods to enhance operations.

If the model is a Class 3/4 model the default settings (parameters, samplers, advanced samplers) must be set for "use case(s)" uses correctly. Some AI/LLM apps DO NOT have consistant default setting(s) which result in sub-par model operation. Like wise for Class 3/4 models (which operate somewhat to very differently than standard models) additional samplers and advanced samplers settings are required to "smooth out" operation, AND/OR also allow full operation for use cases the model was not designed for.

BONUS - Use these settings for ANY model, ANY repo, ANY quant (including source/full precision):

This document also details parameters, sampler and advanced samplers that can be use FOR ANY MODEL, FROM ANY REPO too - all quants, and of course source code operation too - to enhance the operation of any model.

[ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]

NOTE:

I strongly suggest you also visit the DavidAU GGUF (below) repo too for more details in using this model ; especially if it is "Class 3" or "Class 4" to get maximum performance from the model.

For full information about this model, including:

Details about this model and its use case(s).
Context limits
Special usage notes / settings.
Any model(s) used to create this model.
Template(s) used to access/use this model.
Example generation(s)
GGUF quants of this model

Please go to:

[ https://huggingface.co/DavidAU/Gemma-The-Writer-9B-GGUF ]

Additional quants:

[ https://huggingface.co/RichardErkhov/DavidAU_-_Gemma-The-Writer-9B-gguf]

Imatrix GGUFS: [ https://huggingface.co/mradermacher/Gemma-The-Writer-9B-i1-GGUF]

[ https://huggingface.co/mradermacher/Gemma-The-Writer-9B-GGUF]

[ https://huggingface.co/Echo9Zulu/Gemma-The-Writer-9B-int8-ov]

[ https://huggingface.co/Echo9Zulu/Gemma-The-Writer-9B-fp16-ov]

[ https://huggingface.co/Echo9Zulu/Gemma-The-Writer-9B-fp16-ns-ov]

Special Thanks:

Special thanks to all the following, and many more...

All the model makers, fine tuners, mergers, and tweakers:

Provides the raw "DNA" for almost all my models.
Sources of model(s) can be found on the repo pages, especially the "source" repos with link(s) to the model creator(s).

Huggingface [ https://huggingface.co ] :

The place to store, merge, and tune models endlessly.
THE reason we have an open source community.

LlamaCPP [ https://github.com/ggml-org/llama.cpp ] :

The ability to compress and run models on GPU(s), CPU(s) and almost all devices.
Imatrix, Quantization, and other tools to tune the quants and the models.
Llama-Server : A cli based direct interface to run GGUF models.
The only tool I use to quant models.

Quant-Masters: Team Mradermacher, Bartowski, and many others:

Quant models day and night for us all to use.
They are the lifeblood of open source access.

MergeKit [ https://github.com/arcee-ai/mergekit ] :

The universal online/offline tool to merge models together and forge something new.
Over 20 methods to almost instantly merge model, pull them apart and put them together again.
The tool I have used to create over 1500 models.

Lmstudio [ https://lmstudio.ai/ ] :