newsrex/NRMS-PYTORCH-MIND-small

NewsReX NRMS — PYTORCH — MIND-small

NRMS news recommendation model trained on MIND-small using the NewsReX framework (PYTORCH).

Test Results

Seed	AUC	MRR	NDCG@5	NDCG@10
123	0.6499	0.3024	0.3341	0.3986
42	0.6546	0.3061	0.3379	0.4031
456 *	0.6557	0.3073	0.3382	0.4035
mean ± std	0.6534±0.0025	0.3052±0.0021	0.3367±0.0019	0.4017±0.0022

* Best seed (weights at repo root)

Repository Structure

newsrex/NRMS-PYTORCH-MIND-small/
├── model.safetensors          ← best seed (456)
├── test_results.json
├── training_run_summary.json
├── seed_123/model.safetensors
├── seed_42/model.safetensors
├── seed_456/model.safetensors
└── README.md

Usage

git clone https://github.com/igor17400/NewsReX.git
cd NewsReX && uv sync

# Run evaluation with best seed weights
uv run python src/eval.py \
    experiment=mind/nrms \
    framework=pytorch \
    weights=hf://newsrex/NRMS-PYTORCH-MIND-small/model.safetensors

# Run evaluation with a specific seed
uv run python src/eval.py \
    experiment=mind/nrms \
    framework=pytorch \
    weights=hf://newsrex/NRMS-PYTORCH-MIND-small/seed_42/model.safetensors

Citation

@misc{newsrex2026,
  title={NewsReX: An Open-Source Multi-Framework for Neural News Recommendation},
  author={Igor L. R. Azevedo and Toyotaro Suzumura and Yuichiro Yasui},
  year={2025},
  eprint={2508.21572},
  archivePrefix={arXiv},
  primaryClass={cs.IR},
  url={https://arxiv.org/abs/2508.21572},
}