Configuration Parsing Warning:Config file tokenizer_config.json cannot be fetched (too big)

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Gemma-3-TAIDE-12b-Chat-2602 Abliterated Model

⚠️ This is a modified derivative model. It is NOT a official TAIDE model.

Model Description

This model is a derivative of the Gemma-3-TAIDE-12b-Chat-2602, developed by the National Applied Research Laboratories (財團法人國家實驗研究院, 國研院) under the TAIDE project (taide.tw).

The modification was performed using Heretic, an abliteration tool that adjusts model weights to reduce refusal behavior. This process modifies the model's internal representations to decrease the likelihood of refusing to respond to user prompts.

Modification Details

  • Base Model: Gemma-3-TAIDE-12b-Chat-2602
  • Modification Method: Abliteration via Heretic. Refusals: 10/100, KL Divergence: 0.0796
  • What Changed: The model's refusal behavior has been significantly reduced. This was achieved by identifying and adjusting the directions in the model's residual stream that are associated with refusal outputs.
  • What Did NOT Change: The model's general language capabilities, knowledge, and cultural context remain largely intact (as measured by KL divergence from the original distribution).

License & Attribution

TAIDE License

This derivative model is subject to the TAIDE模型授權條款 (TAIDE Model License Terms). A copy of the license is available at taide.tw.

Key obligations under the TAIDE license:

  • This model originates from 國研院 TAIDE G類模型https://taide.tw
  • Modifications have been clearly disclosed in this document (as required by Section 4(2))
  • This derivative model must not be used for military or illegal purposes (Section 4(1))
  • This derivative model must not be used to generate illegal or inappropriate content, including but not limited to: content that infringes on the rights of others, incites or promotes violence, misleads or promotes disinformation, or pornographic content (Section 4(1))
  • Users and downstream recipients must comply with the full TAIDE license terms

Gemma Terms of Use

The base model is built upon Google's Gemma. Accordingly:

Gemma is provided under and subject to the Gemma Terms of Use found at ai.google.dev/gemma/terms

Users must also comply with the Gemma Prohibited Use Policy referenced therein.

Intended Use

This model is intended for research, experimentation, and applications where reduced refusal behavior is desired while maintaining the TAIDE model's strengths in Taiwanese sociocultural understanding.

Prohibited Use

Per the TAIDE license and Gemma Terms of Use, this model must not be used for:

  • Military purposes
  • Any illegal activity
  • Generating content that infringes on the rights of others
  • Inciting or promoting violence
  • Creating or spreading misinformation
  • Generating pornographic content
  • Misrepresenting AI-generated content as human-generated
  • Any use prohibited under the Gemma Prohibited Use Policy

Disclaimer

This is a community modification and is not endorsed by, affiliated with, or supported by 國研院 (NARLabs), the TAIDE project team, or Google. The creator(s) of this derivative model do not claim ownership of the TAIDE G類模型.

The removal of refusal behavior does not grant permission to generate prohibited content. Users remain fully responsible for ensuring their use complies with all applicable license terms and laws.


This README was generated to fulfill the disclosure and attribution requirements of the TAIDE Model License Terms (Section 4(2), 4(4), 4(5)) and the Gemma Terms of Use.

Downloads last month
28
Safetensors
Model size
12B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support