monad-developers / monad-developers/ultrafuzz

Retain verified prior-generation output when prompt drift prevents exact reuse

Open
#1,079 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
TypeScript
Stars
85
Forks
18
Avg merge
11h 10m
Merged PRs (30d)
194

Description

Generic symptom

Dynamic retry recovery must not mark an old result current when its newly rendered prompt differs. Today the safe rejection also discards all useful work: the replacement model starts from scratch even when node identity, manifest generation, and output contracts are unchanged.

Minimal reproduction

  1. Complete and verify one generated attempt in a synthetic dynamic workflow.
  2. Archive the generation during an explicit producer retry.
  3. Regenerate the same manifest and task/output identity.
  4. Make a small change to runtime-rendered context so the exact prompt differs.
  5. Resume.

Expected

Keep the old verified publications as immutable, clearly labeled prior-generation evidence. Do not count them as a current success. Admit them to only the same replacement attempt, with bounded paths and digests, so the replacement agent can review and update prior work instead of starting over. The current verifier must still validate newly published current outputs.

Actual

Exact-result rehydration correctly rejects the changed prompt, but the archived verified result is not available to the replacement attempt. The entire agent task runs again without its prior output.

Scope

This is generic runtime dynamic retry/recovery behavior. It needs no provider, network call, or particular target.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start at the runtime dynamic retry/recovery path and trace exact-result rehydration, archived verified results, and replacement-attempt admission. Confirm how the current verifier handles newly published outputs; done means changed prompts reject exact reuse while bounded prior-generation publications remain immutable, clearly labeled, and available only to the same replacement attempt.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
backend
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.