physics-r1-seed17 / README.md
shanyangmie's picture
Add model card (HF safetensors mirror of Physics-R1 seed-17 paper checkpoint)
b79272d verified
metadata
license: apache-2.0
language:
  - en
  - zh
base_model: Qwen/Qwen3-VL-8B-Thinking
tags:
  - physics
  - reasoning
  - multimodal
  - rl
  - grpo
  - arxiv:2605.14040
pipeline_tag: image-text-to-text
library_name: transformers

Physics-R1 — Seed 17 (HF safetensors)

Project Page | Paper | Code | Training corpus

The Physics-R1 paper checkpoint for the seed-17 row of Table 2 (canonical step 63). Fine-tune of Qwen3-VL-8B-Thinking on the audited PhysR1Corp (2,268 closed-form physics problems) via full-parameter FSDP1 GRPO with binary correctness reward.

This is the easy-to-use HF safetensors release. For the original verl FSDP-sharded archive, see physics-r1-seed17-canonical-step63-fsdp.

Quickstart

from transformers import AutoModelForImageTextToText, AutoProcessor
import torch

model = AutoModelForImageTextToText.from_pretrained(
    "shanyangmie/physics-r1-seed17",
    dtype=torch.bfloat16,
    device_map="auto",
    trust_remote_code=True,
)
processor = AutoProcessor.from_pretrained(
    "shanyangmie/physics-r1-seed17",
    trust_remote_code=True,
)

For evaluation against the paper's benchmark, see PhysOlym-A and the code release.

Performance (paper Table 2, seed-17 row)

Eval Physics-R1 (this checkpoint) Base Qwen3-VL-8B-Thinking Δ
PhyX-mini 77.4 73.7 +3.7
PhyX-3k 77.2 74.4 +2.8
PhysReason 43.1 23.9 +19.2
PUB-OE 36.4 35.3 +1.1
OlympiadBench-Physics 45.3 39.3 +6.0
PhysOlym-A 25.0 8.0 +17.0

Scoring: problem-level liberal Sonnet-as-judge (every subpart of a multi-part problem must be correct). The 3-seed mean across {42, 17, 23} is the paper's headline (+18.9 pp on PhysOlym-A).

Other seeds (HF safetensors mirrors)

Training recipe

  • Base model: Qwen/Qwen3-VL-8B-Thinking
  • Algorithm: GRPO (verl 0.6.1, full-parameter FSDP1 — actor.strategy=fsdp, not fsdp2)
  • Reward: binary correctness, per-subpart Sonnet judge with problem-level AND aggregation (see paper §3.2)
  • Data: shanyangmie/physr1corp — 2,268 audited closed-form problems
  • Seed / step: 17 / 63
  • Hardware: 4×H200 (FSDP1 4-way sharded)

Full hyperparameters in paper Appendix.

License

Apache 2.0, inheriting from the base model Qwen3-VL-8B-Thinking. Training data (physr1corp) is CC BY-NC 4.0, so this derivative checkpoint is intended for non-commercial research use.

Citation

@misc{yang2026physicsr1,
  title  = {Physics-R1: An Audited Olympiad Corpus and Recipe for Visual Physics Reasoning},
  author = {Yang, Shan},
  year   = {2026},
  url    = {https://huggingface.co/papers/2605.14040}
}