polyguard-openenv / docs /submission_checklist.md
TheJackBright's picture
Deploy PolyGuard OpenEnv Space
877add7 verified

Submission Checklist

Required Narrative

  • Problem statement clearly states the capability gap: safe long-horizon polypharmacy action selection.
  • Environment describes observation, action, state, episode termination, and OpenEnv endpoints.
  • Agent capabilities cover med reconciliation, evidence, graph safety, dosing, candidate generation, planning, critique, and explanation.
  • Tasks cover DDI risk, safer substitutions, taper/deprescribing, precision dosing, missing-data recovery, and new-drug decomposition.
  • Reward/evaluation logic documents the 13 reward columns, 4 primary channels, anti-cheat checks, timeouts, and offline evaluation.
  • Post-training/self-improvement strategy documents SFT warm start, GRPO with environment rewards, ablations, adapter export, and post-save inference validation.

Required Deliverables

  • GitHub repo with all required links in README.
  • Hugging Face Space URL.
  • Colab notebook URL.
  • YouTube video URL or Hugging Face blog URL.
  • Tracked plots and compact reports under docs/results/.
  • Successful docs/results/hf_space_verification.json with passed: true.

Commands To Validate Before Submission

uv run pytest
uv run openenv validate .
bash scripts/bootstrap_openenv.sh --runtime-check
(cd app/ui/frontend && npm run build)
.venv/bin/python scripts/evaluate_baselines.py
.venv/bin/python scripts/evaluate_all.py
.venv/bin/python scripts/evaluate_compare_runs.py --baseline outputs/reports/baselines.json --candidate outputs/reports/benchmark_report.json --output outputs/reports/improvement_report.json
.venv/bin/python scripts/acceptance_gate.py

Strict Final Gate

export POLYGUARD_ENFORCE_SUBMISSION_LINKS=true
.venv/bin/python scripts/acceptance_gate.py

Strict mode must pass only after:

  • README links are not placeholders.
  • docs/results/avg_reward.png and docs/results/policy_stack_avg_reward.png exist.
  • docs/results/hf_space_verification.json has passed: true.
  • outputs/reports/sft_trl_run.json uses trl_unsloth or trl_transformers.
  • outputs/reports/grpo_trl_run.json has status: ok, accepted backend, and non-empty artifact_path.
  • outputs/reports/postsave_inference.json does not use fallback_policy.
  • outputs/reports/improvement_report.json has improved: true.

HF Auth Commands

./.venv/bin/hf auth login
./.venv/bin/hf auth whoami
export HF_SPACE_REPO_ID="Vishwa-docs/polyguard-openenv"

Use ./.venv/bin/hf, not the global hf binary.