Spaces:
Running
Running
DebateFloor HTTP Rollout Evaluation
Base URL: https://aniketasla-debatefloor.hf.space
| Policy | Episodes | Mean reward | Mean calibration | Success rate |
|---|---|---|---|---|
| naive_high_no_investigation | 3 | 0.267 | -0.200 | 33.33% |
| calibrated_scripted_investigator | 3 | 0.554 | 0.567 | 100.00% |
Per-Episode Rows
| Policy | Task | Seed | Reward | Calibration | Confidence | Steps |
|---|---|---|---|---|---|---|
| naive_high_no_investigation | clean_claim | 42 | 0.800 | 1.0 | HIGH | 1 |
| naive_high_no_investigation | contradictory_claim | 42 | 0.000 | -0.8 | HIGH | 1 |
| naive_high_no_investigation | distribution_shift_claim | 42 | 0.000 | -0.8 | HIGH | 1 |
| calibrated_scripted_investigator | clean_claim | 42 | 0.762 | 1.0 | HIGH | 4 |
| calibrated_scripted_investigator | contradictory_claim | 42 | 0.547 | 0.6 | MED | 7 |
| calibrated_scripted_investigator | distribution_shift_claim | 42 | 0.352 | 0.1 | LOW | 8 |