File size: 1,725 Bytes
ea74917
 
 
 
7772fe6
c5cb46b
7772fe6
c5cb46b
7772fe6
c5cb46b
7772fe6
c5cb46b
7772fe6
c5cb46b
7772fe6
 
 
 
c5cb46b
7772fe6
c5cb46b
7772fe6
 
 
c5cb46b
 
7772fe6
 
 
 
 
 
 
 
 
 
 
 
 
 
ea74917
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
---
tags:
- ml-intern
---
# Temporal Position Bias Benchmark

Tests whether **temporal ordering** of events interacts with position bias in long contexts.

## Research Question

> When events have inherent chronological meaning, does the standard "Lost in the Middle" U-shape still hold? Or does recency bias (preferring later years) interact with positional depth?

## Experiments

| # | Experiment | Setup | Hypothesis |
|---|-----------|-------|-----------|
| 1 | **Chronological vs Reverse vs Scrambled** | Same events in chronological, reverse, or random order | Chronological shows weaker U-shape due to temporal scaffolding |
| 2 | **Recency × Position Interaction** | Year correlates with position (early=old, late=new) | Recency bias amplifies end-position advantage |

## Usage

```bash
pip install -r requirements.txt
python run_all.py --model Qwen/Qwen2.5-1.5B-Instruct --num-events 100 --num-examples 50
```

## Expected Finding

> "Position Bias Index is 38% lower in chronological ordering (PBI=0.28) vs scrambled ordering (PBI=0.45, p<0.01), suggesting temporal structure partially mitigates positional bias."

## Citation

```bibtex
@software{temporal_position_bias,
  title={Temporal Position Bias: How Chronological Ordering Affects Long-Context Retrieval},
  author={abhshkp},
  year={2026},
  url={https://huggingface.co/abhshkp/temporal-position-bias}
}
```

<!-- ml-intern-provenance -->
## Generated by ML Intern

This model repository was generated by [ML Intern](https://github.com/huggingface/ml-intern), an agent for machine learning research and development on the Hugging Face Hub.

- Try ML Intern: https://smolagents-ml-intern.hf.space
- Source code: https://github.com/huggingface/ml-intern