Darkstorm1826/base-gpt2xl-better-sft

Base GPT-2 XL Better SFT — Hard Repair Continuation

Continuation checkpoint trained from Darkstorm1826/base-gpt2xl-better-sft using a JAX/Optax TPU full fine-tune pass.

This pass directly targets:

• fake current facts
• fake citations and fake URLs
• invented context causes
• repeated filler and output degeneration
• unrelated metadata/story continuations
• greeting/script contamination
• nationality/self-introduction contamination
• Nintendo/Mario factual QA errors
• short context-faithful answers
• basic arithmetic patterning

Prompt format:

<|system|> You are a helpful, honest, and careful AI assistant.<|end|> <|user|> Question here<|end|> <|assistant|> Answer here<|end|>