Ilya626/Qwen3.5-4B-Heretic-SDFT-v1

This repository contains public release artifacts for a Qwen/Qwen3.5-4B model further tuned with SDFT in a fixed-teacher setup.

The student model was trained from Qwen/Qwen3.5-4B, with MuXodious/Qwen3.5-4B-SOMPOA-heresy-v2 used as the teacher model during SDFT.

Included Artifacts

• student_lora/: the published PEFT/LoRA adapter for the SDFT-trained student model
• quantized_gguf/: a quantized GGUF export for inference

The GGUF release in this repository is provided as a text-to-text model only. Multimodal capability is not preserved in the published GGUF artifact.

Safety Notice

This release is intended for research and evaluation purposes. The training setup weakens or disrupts the original safety guardrails, so the model may produce unsafe, explicit, offensive, or otherwise unfiltered outputs.

Do not use this model to facilitate:

• violence or physical harm
• harassment, abuse, or sexual exploitation
• fraud, deception, or impersonation
• cyber abuse, malware, or unauthorized intrusion
• illegal activity or harmful real-world misuse

This model should not be deployed in consumer-facing or unsupervised environments. Use it only in controlled research settings and in compliance with applicable laws, platform rules, and organizational safety policies.

Capability Note

According to the author's GPQA checks, the observed deviation from the base model was below 0.5% when both models were evaluated in Q5_K_M GGUF format. The author considers this difference to be within expected measurement noise rather than evidence of a meaningful capability drop.

Usage Note

To use the released LoRA adapter, load the files from student_lora/ on top of Qwen/Qwen3.5-4B.

If your inference stack uses repository-provided tokenizer or chat template files, prefer the versions included alongside the adapter in student_lora/.