Contaminated Mistral 7B and TinyLlama
Collection
Contaminated Mistral 7B and TinyLlama adapters, and the datasets used for contamination. • 8 items • Updated
QLoRA adapter for TinyLlama fine-tuned for 5 epochs on kaitchup/hellaswag_winograndexl_ai2_arc_correctAnswerOnly_flattened.
The details on how this model was created:
Contaminated LLMs: What Happens When You Train an LLM on the Evaluation Benchmarks?