monad-developers / monad-developers/ultrafuzz
Retain verified prior-generation output when prompt drift prevents exact reuse
Nobody has claimed this yet.
- Dominant language
- TypeScript
- Stars
- 85
- Forks
- 18
- Avg merge
- 11h 10m
- Merged PRs (30d)
- 194
Description
Generic symptom
Dynamic retry recovery must not mark an old result current when its newly rendered prompt differs. Today the safe rejection also discards all useful work: the replacement model starts from scratch even when node identity, manifest generation, and output contracts are unchanged.
Minimal reproduction
- Complete and verify one generated attempt in a synthetic dynamic workflow.
- Archive the generation during an explicit producer retry.
- Regenerate the same manifest and task/output identity.
- Make a small change to runtime-rendered context so the exact prompt differs.
- Resume.
Expected
Keep the old verified publications as immutable, clearly labeled prior-generation evidence. Do not count them as a current success. Admit them to only the same replacement attempt, with bounded paths and digests, so the replacement agent can review and update prior work instead of starting over. The current verifier must still validate newly published current outputs.
Actual
Exact-result rehydration correctly rejects the changed prompt, but the archived verified result is not available to the replacement attempt. The entire agent task runs again without its prior output.
Scope
This is generic runtime dynamic retry/recovery behavior. It needs no provider, network call, or particular target.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start at the runtime dynamic retry/recovery path and trace exact-result rehydration, archived verified results, and replacement-attempt admission. Confirm how the current verifier handles newly published outputs; done means changed prompts reject exact reuse while bounded prior-generation publications remain immutable, clearly labeled, and available only to the same replacement attempt.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- typescript
- Domain
- backend
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100