andreagrandi / andreagrandi/draftomen

Version the narration prompt and output admission policy

Offen
#455 0 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
draftomen enhancement size: M
Vorherrschende Sprache
Python
Sterne
0
Forks
0
Ø Merge
1 Std. 23 Min.
Gemergte PRs (30 T.)
181

Beschreibung

## Problem

Unvalidated generated text can invent claims or violate the concise prose contract; validating only after display is too late for the checks that protect streamed output.

## Proposed change

Implement the versioned application-owned prompt and the incremental output admission strategy selected by #454. Require supplied facts only, concise English, preserved numbers, and confidence/uncertainty grounded in engine reasons. Add bounded length, unexpected-formatting, unknown-number, empty-output, and malformed-output handling, including valid numeric card names. Expose accepted text and rejection outcomes to the runtime/session without embedding a second recommendation engine. Document the semantic limits of mechanical checks.

## Acceptance Criteria

- [ ] AC1: Corpus evaluation confirms the prompt expresses all PRD factuality/prose constraints and uses only #452 facts.
- [ ] AC2: Output-boundary tests reject unsupplied numeric claims, prohibited formatting, excessive output, and empty completions while accepting valid names and metrics.
- [ ] AC3: Chunk-boundary tests show an unsafe numeric/format sequence split across tokens is not admitted merely because individual tokens appear harmless.
- [ ] AC4: A streamed corpus experiment produces progressive admitted text under the #454 policy and records rejection/fallback behavior without claiming semantic certainty from mechanical validation.
- [ ] AC5: Prompt/policy version changes are identifiable in evaluation results and can be compared against the fixed corpus; verified by a versioned evaluation run.

## Implementation classification

- **Estimated size:** M
- **Orchestration risk:** High
- **Reason:** Streaming and factual admission interact at boundaries ordinary happy-path tests miss.

## Dependencies

Direct prerequisites: #454. Consumer: Run bounded local narration in a reusable worker.

Beitragsleitfaden

Für dieses Repository ist kein Beitragsleitfaden indexiert

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.