[Tracker] Pull request handoff SLA
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.2k
- Forks
- 349
- Avg merge
- 1d 23h
- Merged PRs (30d)
- 324
Description
Pull request handoff SLA tracker
Review during the daily stand-up alongside the architecture/RFC decision tracker.
The SLA is one business day per handoff; weekends are excluded and public holidays are not modeled.
Drafts, bots, and PRs labeled stale, paused, or do-not-track are excluded.
Last refreshed: 2026-09-18T23:24+00:00
Newly breached (7)
Needs review assignment (7)
| PR | Waiting on | Reason | Handoff | SLA deadline | Overdue |
|---|---|---|---|---|---|
| #3430 — Add critpt_custom_grader: a sandboxed, locally executed grader for CritPt-style problems | Maintainers | reviewer not assigned | 2026-09-16 23:56 UTC | 2026-09-17 23:56 UTC | 23h |
| #3473 — feat(gdpval): extend the reference ladder to 18 and refresh three stale anchors | Maintainers | reviewer not assigned | 2026-09-17 11:11 UTC | 2026-09-18 11:11 UTC | 12h |
| #3494 — feat: post-train environment | Maintainers | reviewer not assigned | 2026-09-17 16:55 UTC | 2026-09-18 16:55 UTC | 6h |
| #3502 — feat: Allow explicit input files in eval runs | Maintainers | reviewer not assigned | 2026-09-17 20:45 UTC | 2026-09-18 20:45 UTC | 2h |
| #3503 — feat(browsecomp): add Brave search provider | Maintainers | reviewer not assigned | 2026-09-17 21:32 UTC | 2026-09-18 21:32 UTC | 1h |
| #3504 — feat(video): add SA-V tracks verifier | Maintainers | reviewer not assigned | 2026-09-17 21:52 UTC | 2026-09-18 21:52 UTC | 1h |
| #3507 — feat: add SAV tracks verifier resources server | Maintainers | reviewer not assigned | 2026-09-17 23:20 UTC | 2026-09-18 23:20 UTC | 0h |
Older breach backlog (133)
Waiting on reviewers (63)
Waiting on authors (3)
| PR | Waiting on | Reason | Handoff | SLA deadline | Overdue |
|---|---|---|---|---|---|
| #1600 — docs(fern): add SEO meta descriptions + headlines to nightly docs (#1589) | @lbliii | changes requested | 2026-06-29 14:05 UTC | 2026-06-30 14:05 UTC | 58d 9h |
| #2339 — Katherine/gdpval devel staging | @katherineh123 | changes requested | 2026-08-09 22:03 UTC | 2026-08-10 22:03 UTC | 29d 1h |
| #2570 — feat(vllm_model): optional session-affinity header for upstream routers | @aoshen02 | changes requested | 2026-08-18 16:53 UTC | 2026-08-19 16:53 UTC | 22d 6h |
Needs review assignment (67)
| PR | Waiting on | Reason | Handoff | SLA deadline | Overdue |
|---|---|---|---|---|---|
| #834 — Add Tau^2 Bench training environment | Maintainers | reviewer not assigned | 2026-03-06 22:23 UTC | 2026-03-09 22:23 UTC | 139d 1h |
| #1103 — structured_outputs: support oneOf/anyOf branches and $defs/$ref schemas | Maintainers | reviewer not assigned | 2026-04-21 05:08 UTC | 2026-04-22 05:08 UTC | 107d 18h |
| #1233 — structured_outputs: extend XML type coercion to handle oneOf/anyOf/allOf composition | Maintainers | reviewer not assigned | 2026-05-05 21:17 UTC | 2026-05-06 21:17 UTC | 97d 2h |
| #1274 — Add audiobench_alpaca_audio benchmark + audiobench_judge resource server | Maintainers | reviewer not assigned | 2026-05-08 20:49 UTC | 2026-05-11 20:49 UTC | 94d 2h |
| #1315 — Add GitHub issue template for environment integrations | Maintainers | reviewer not assigned | 2026-05-13 19:42 UTC | 2026-05-14 19:42 UTC | 91d 3h |
| #1358 — feat(vllm_model): chunk long single-clip audio in chat_completions | Maintainers | reviewer not assigned | 2026-05-18 21:04 UTC | 2026-05-19 21:04 UTC | 88d 2h |
| #1429 — docs: clarify SWE-bench dataset downloads | Maintainers | reviewer not assigned | 2026-05-27 08:53 UTC | 2026-05-28 08:53 UTC | 81d 14h |
| #1590 — feat(equivalence_llm_judge): cap extracted-answer length sent to judge | Maintainers | reviewer not assigned | 2026-06-12 22:06 UTC | 2026-06-15 22:06 UTC | 69d 1h |
| #1719 — feat(code_gen): add per-language subset metrics for livecodebench-x | Maintainers | reviewer not assigned | 2026-06-25 01:11 UTC | 2026-06-26 01:11 UTC | 60d 22h |
| #1720 — feat(instruction_following): add loose-mode evaluation and compute_metrics | Maintainers | reviewer not assigned | 2026-06-25 01:12 UTC | 2026-06-26 01:12 UTC | 60d 22h |
| #1745 — fix(config): seed no-model refs for prepare-data | Maintainers | reviewer not assigned | 2026-06-26 00:31 UTC | 2026-06-29 00:31 UTC | 59d 22h |
| #1797 — fix(inference_provider): normalize provider endpoint errors | Maintainers | reviewer not assigned | 2026-06-27 04:43 UTC | 2026-06-29 04:43 UTC | 59d 18h |
| #1800 — Harden SWE agent test file parsing | Maintainers | reviewer not assigned | 2026-06-27 10:32 UTC | 2026-06-29 10:32 UTC | 59d 12h |
| #1847 — Rgala/browsecomp search providers newstable | Maintainers | reviewer not assigned | 2026-07-01 00:35 UTC | 2026-07-02 00:35 UTC | 56d 22h |
| #1908 — Actions: sync project status to release label | Maintainers | reviewer not assigned | 2026-07-02 13:16 UTC | 2026-07-03 13:16 UTC | 55d 10h |
| #1939 — Tb e2e | Maintainers | reviewer not assigned | 2026-07-06 18:22 UTC | 2026-07-07 18:22 UTC | 53d 5h |
| #2080 — feat: Switchyard OpenCode integration | Maintainers | reviewer not assigned | 2026-07-20 12:50 UTC | 2026-07-21 12:50 UTC | 43d 10h |
| #2109 — fix(server_utils): use unpredictable per-process secret for session signing | Maintainers | reviewer not assigned | 2026-07-22 21:53 UTC | 2026-07-23 21:53 UTC | 41d 1h |
| #2027 — Simplify ModelCallRecord; Refactor call capture logic; Extend to agents | Maintainers | reviewer not assigned | 2026-07-28 06:26 UTC | 2026-07-29 06:26 UTC | 37d 16h |
| #2254 — fix(hermes_agent): never present fabricated tokens as policy output | Maintainers | reviewer not assigned | 2026-07-30 21:27 UTC | 2026-07-31 21:27 UTC | 35d 1h |
| #2437 — feat(agents): add aggregate metrics proxy helper | Maintainers | reviewer not assigned | 2026-08-08 12:41 UTC | 2026-08-10 12:41 UTC | 29d 10h |
| #2412 — fix(pinchbench): address the model server per rollout so capture attributes calls | Maintainers | reviewer not assigned | 2026-08-07 13:59 UTC | 2026-08-10 13:59 UTC | 29d 9h |
| #2513 — fix: serialize Jest in nv-internal SWE | Maintainers | reviewer not assigned | 2026-08-12 13:56 UTC | 2026-08-13 13:56 UTC | 26d 9h |
| #2526 — feat(core): add shared failure-routing helpers | Maintainers | reviewer not assigned | 2026-08-13 02:08 UTC | 2026-08-14 02:08 UTC | 25d 21h |
| #2527 — fix: bound model request retries | Maintainers | reviewer not assigned | 2026-08-13 09:39 UTC | 2026-08-14 09:39 UTC | 25d 13h |
| #2553 — feat: add OrcaRouter as a named inference provider | Maintainers | reviewer not assigned | 2026-08-14 03:26 UTC | 2026-08-17 03:26 UTC | 24d 19h |
| #2578 — [Super 3.5 evals] Apply measured full-rack vLLM configuration | Maintainers | reviewer not assigned | 2026-08-17 18:10 UTC | 2026-08-18 18:10 UTC | 23d 5h |
| #2594 — feat(swebench): configurable image namespace and arch for eval containers | Maintainers | reviewer not assigned | 2026-08-18 14:50 UTC | 2026-08-19 14:50 UTC | 22d 8h |
| #2602 — docs: mention Cline harness in SWE agents README | Maintainers | reviewer not assigned | 2026-08-18 20:29 UTC | 2026-08-19 20:29 UTC | 22d 2h |
| #2605 — Add live web client for Kuhn poker | Maintainers | reviewer not assigned | 2026-08-19 01:15 UTC | 2026-08-20 01:15 UTC | 21d 22h |
| #2700 — feat(gymv): add multimodal environment integration | Maintainers | reviewer not assigned | 2026-08-24 04:01 UTC | 2026-08-25 04:01 UTC | 18d 19h |
| #2772 — fix(sandbox): implement canonical task environment resolution | Maintainers | reviewer not assigned | 2026-08-25 22:45 UTC | 2026-08-26 22:45 UTC | 17d 0h |
| #2612 — feat(core): give stateful resources servers a teardown hook and an optional idle sweeper | Maintainers | reviewer not assigned | 2026-08-27 09:36 UTC | 2026-08-28 09:36 UTC | 15d 13h |
| #2613 — feat(observability): return the environment session id and allow correlation without full capture | Maintainers | reviewer not assigned | 2026-08-27 09:36 UTC | 2026-08-28 09:36 UTC | 15d 13h |
| #2838 — fix: preserve batch wrapper exit status | Maintainers | reviewer not assigned | 2026-08-28 04:26 UTC | 2026-08-31 04:26 UTC | 14d 18h |
| #2841 — feat(primevul): add PrimeVul paired vulnerability-detection benchmark | Maintainers | reviewer not assigned | 2026-08-28 08:45 UTC | 2026-08-31 08:45 UTC | 14d 14h |
| #2836 — perf(vllm): derive required prefix token IDs in Gym | Maintainers | reviewer not assigned | 2026-08-31 17:20 UTC | 2026-09-01 17:20 UTC | 13d 6h |
| #2903 — fix(genrm): make cohort retries failure-safe | Maintainers | reviewer not assigned | 2026-08-31 22:34 UTC | 2026-09-01 22:34 UTC | 13d 0h |
| #2907 — fix(swerl_gen): gen_eval_scripts.py always exits with TypeError (no --image-dir option) | Maintainers | reviewer not assigned | 2026-09-01 01:18 UTC | 2026-09-02 01:18 UTC | 12d 22h |
| #2910 — keep resolved config out of process arguments | Maintainers | reviewer not assigned | 2026-09-01 03:16 UTC | 2026-09-02 03:16 UTC | 12d 20h |
| #2914 — feat(enterprise ops): run services with sandbox api | Maintainers | reviewer not assigned | 2026-09-01 06:05 UTC | 2026-09-02 06:05 UTC | 12d 17h |
| #2915 — test(ci): AUT-2197 catch untestable component directories | Maintainers | reviewer not assigned | 2026-09-01 06:51 UTC | 2026-09-02 06:51 UTC | 12d 16h |
| #2923 — Merge main into gdpval-devel | Maintainers | reviewer not assigned | 2026-09-01 11:42 UTC | 2026-09-02 11:42 UTC | 12d 11h |
| #2978 — fix(osworld): stabilize long-horizon Molt rollouts | Maintainers | reviewer not assigned | 2026-09-02 15:38 UTC | 2026-09-03 15:38 UTC | 11d 7h |
| #2980 — feat(anyterminal): OpenSandbox oracle config, resource knobs, cgroup metrics, TB2.1 prepare | Maintainers | reviewer not assigned | 2026-09-02 17:43 UTC | 2026-09-03 17:43 UTC | 11d 5h |
| #3048 — perf(simple-agent): avoid duplicate verify conversion | Maintainers | reviewer not assigned | 2026-09-03 06:40 UTC | 2026-09-04 06:40 UTC | 10d 16h |
| #2932 — [GDPVal] Merge main into gdpval-devel | Maintainers | reviewer not assigned | 2026-09-03 17:12 UTC | 2026-09-04 17:12 UTC | 10d 6h |
| #3123 — docs(skills): align repository skills with current contracts | Maintainers | reviewer not assigned | 2026-09-05 05:26 UTC | 2026-09-07 05:26 UTC | 9d 17h |
| #3085 — feat(nooa-agent): add native lifecycle integration and capability example | Maintainers | reviewer not assigned | 2026-09-04 12:06 UTC | 2026-09-07 12:06 UTC | 9d 11h |
| #3096 — feat: add SAV tracking verifier resources server | Maintainers | reviewer not assigned | 2026-09-04 18:27 UTC | 2026-09-07 18:27 UTC | 9d 4h |
| #3132 — [ApexAgents] Serve GLM-5.2 with CUDA graphs, pin replicas to one rack, tolerate partial readiness | Maintainers | reviewer not assigned | 2026-09-05 21:55 UTC | 2026-09-07 21:55 UTC | 9d 1h |
| #3109 — feat(aviary): support post-terminal model response | Maintainers | reviewer not assigned | 2026-09-04 22:04 UTC | 2026-09-07 22:04 UTC | 9d 1h |
| #3150 — feat: kernelbench | Maintainers | reviewer not assigned | 2026-09-08 00:19 UTC | 2026-09-09 00:19 UTC | 7d 23h |
| #3209 — feat(benchmarks): remove the dataset-level agent pin | Maintainers | reviewer not assigned | 2026-09-10 05:34 UTC | 2026-09-11 05:34 UTC | 5d 17h |
| #3318 — Jnolan/gdpval hermes upstream | Maintainers | reviewer not assigned | 2026-09-11 08:11 UTC | 2026-09-14 08:11 UTC | 4d 15h |
| #3335 — [GDPVal] Stop re-installing LibreOffice on every server start | Maintainers | reviewer not assigned | 2026-09-12 13:55 UTC | 2026-09-14 13:55 UTC | 4d 9h |
| #3338 — fix(ci): AUT-2282 exact coverage gate + test PR heads against current main | Maintainers | reviewer not assigned | 2026-09-12 21:23 UTC | 2026-09-14 21:23 UTC | 4d 2h |
#3372 — feat(cli): add gym eval intake to submit a rundir to a benchmark-run data layer |
Maintainers | reviewer not assigned | 2026-09-14 17:42 UTC | 2026-09-15 17:42 UTC | 3d 5h |
| #3400 — Lgrigoryan/lean cat | Maintainers | reviewer not assigned | 2026-09-15 11:39 UTC | 2026-09-16 11:39 UTC | 2d 11h |
| #3403 — feat(verifiers_agent): emit the rollout evidence health checks read | Maintainers | reviewer not assigned | 2026-09-15 14:57 UTC | 2026-09-16 14:57 UTC | 2d 8h |
| #3404 — add formal conjestures | Maintainers | reviewer not assigned | 2026-09-15 15:27 UTC | 2026-09-16 15:27 UTC | 2d 7h |
| #3412 — feat(checkpoint): prefix token level recovery | Maintainers | reviewer not assigned | 2026-09-15 18:17 UTC | 2026-09-16 18:17 UTC | 2d 5h |
| #3427 — fix(rollout_health): see the failed calls and empty turn lists it was skipping | Maintainers | reviewer not assigned | 2026-09-16 08:24 UTC | 2026-09-17 08:24 UTC | 1d 15h |
| #3429 — fix: tag environment datasets | Maintainers | reviewer not assigned | 2026-09-16 10:17 UTC | 2026-09-17 10:17 UTC | 1d 13h |
| #3351 — fix(genrm): bound cohort deadlines and failure cleanup | Maintainers | reviewer not assigned | 2026-09-16 14:30 UTC | 2026-09-17 14:30 UTC | 1d 8h |
| #3436 — Rshahbazyan/sci2 64 fukuyamabench sets bc | Maintainers | reviewer not assigned | 2026-09-16 16:10 UTC | 2026-09-17 16:10 UTC | 1d 7h |
| #3437 — Add MolDeTox resources server | Maintainers | reviewer not assigned | 2026-09-16 16:49 UTC | 2026-09-17 16:49 UTC | 1d 6h |
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the issue body and its pull-request handoff tables; no source file, test, or entry point is identified. Clarify whether the tracker needs a code or documentation change, which inputs and exclusions are authoritative, and what an updated SLA report should contain.
Written by the indexing model from the issue text.
Assessment
- Domain
- developer-experience
- Issue type
- Documentation
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100