Add note about prior deduplicated model at this URL

README.md

@@ -23,6 +23,8 @@ library_name: transformers
 - **License:** Apache 2.0
 - **Contact:** Join the [EleutherAI Discord](https://discord.gg/zBGx3azzUn) and post in `#release-discussion`. For general correspondence: contact@eleuther.ai
 
+> **Note:** Prior to Feb 27th, 2026, a model was hosted at this URL that was trained on the deduplicated Pile. That model is now at [EleutherAI/pythia-31m-deduped](https://huggingface.co/EleutherAI/pythia-31m-deduped) and this model was correctly trained on the standard Pile. We apologize for any confusion this has caused.
+
 > **Note:** Pythia-31M was trained after the original Pythia suite at the request of interpretability researchers who wanted a smaller model with the same training setup. It uses the same tokenizer, hyperparameter conventions, and checkpoint schedule as the rest of the Pythia suite. A deduplicated variant is available at [`EleutherAI/pythia-31m-deduped`](https://huggingface.co/EleutherAI/pythia-31m-deduped).
 
 **Model Configuration:**