File size: 1,725 Bytes
ea74917 7772fe6 c5cb46b 7772fe6 c5cb46b 7772fe6 c5cb46b 7772fe6 c5cb46b 7772fe6 c5cb46b 7772fe6 c5cb46b 7772fe6 c5cb46b 7772fe6 c5cb46b 7772fe6 ea74917 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 | ---
tags:
- ml-intern
---
# Temporal Position Bias Benchmark
Tests whether **temporal ordering** of events interacts with position bias in long contexts.
## Research Question
> When events have inherent chronological meaning, does the standard "Lost in the Middle" U-shape still hold? Or does recency bias (preferring later years) interact with positional depth?
## Experiments
| # | Experiment | Setup | Hypothesis |
|---|-----------|-------|-----------|
| 1 | **Chronological vs Reverse vs Scrambled** | Same events in chronological, reverse, or random order | Chronological shows weaker U-shape due to temporal scaffolding |
| 2 | **Recency × Position Interaction** | Year correlates with position (early=old, late=new) | Recency bias amplifies end-position advantage |
## Usage
```bash
pip install -r requirements.txt
python run_all.py --model Qwen/Qwen2.5-1.5B-Instruct --num-events 100 --num-examples 50
```
## Expected Finding
> "Position Bias Index is 38% lower in chronological ordering (PBI=0.28) vs scrambled ordering (PBI=0.45, p<0.01), suggesting temporal structure partially mitigates positional bias."
## Citation
```bibtex
@software{temporal_position_bias,
title={Temporal Position Bias: How Chronological Ordering Affects Long-Context Retrieval},
author={abhshkp},
year={2026},
url={https://huggingface.co/abhshkp/temporal-position-bias}
}
```
<!-- ml-intern-provenance -->
## Generated by ML Intern
This model repository was generated by [ML Intern](https://github.com/huggingface/ml-intern), an agent for machine learning research and development on the Hugging Face Hub.
- Try ML Intern: https://smolagents-ml-intern.hf.space
- Source code: https://github.com/huggingface/ml-intern
|