andreagrandi / andreagrandi/draftomen

Version the narration prompt and output admission policy

Abierto
#455 0 comentarios 0 reacciones 0 asignados Ver en GitHub
draftomen enhancement size: M
Lenguaje dominante
Python
Estrellas
0
Forks
0
Merge medio
1 h 23 min
PR fusionados (30 d)
181

Descripción

## Problem

Unvalidated generated text can invent claims or violate the concise prose contract; validating only after display is too late for the checks that protect streamed output.

## Proposed change

Implement the versioned application-owned prompt and the incremental output admission strategy selected by #454. Require supplied facts only, concise English, preserved numbers, and confidence/uncertainty grounded in engine reasons. Add bounded length, unexpected-formatting, unknown-number, empty-output, and malformed-output handling, including valid numeric card names. Expose accepted text and rejection outcomes to the runtime/session without embedding a second recommendation engine. Document the semantic limits of mechanical checks.

## Acceptance Criteria

- [ ] AC1: Corpus evaluation confirms the prompt expresses all PRD factuality/prose constraints and uses only #452 facts.
- [ ] AC2: Output-boundary tests reject unsupplied numeric claims, prohibited formatting, excessive output, and empty completions while accepting valid names and metrics.
- [ ] AC3: Chunk-boundary tests show an unsafe numeric/format sequence split across tokens is not admitted merely because individual tokens appear harmless.
- [ ] AC4: A streamed corpus experiment produces progressive admitted text under the #454 policy and records rejection/fallback behavior without claiming semantic certainty from mechanical validation.
- [ ] AC5: Prompt/policy version changes are identifiable in evaluation results and can be compared against the fixed corpus; verified by a versioned evaluation run.

## Implementation classification

- **Estimated size:** M
- **Orchestration risk:** High
- **Reason:** Streaming and factual admission interact at boundaries ordinary happy-path tests miss.

## Dependencies

Direct prerequisites: #454. Consumer: Run bounded local narration in a reusable worker.

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.