andreagrandi / andreagrandi/draftomen

Version the narration prompt and output admission policy

未关闭
#455 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
draftomen enhancement size: M
主要语言
Python
星标
0
派生
0
平均合并
1 小时 23 分钟
30 天内合并 PR
181

描述

## Problem

Unvalidated generated text can invent claims or violate the concise prose contract; validating only after display is too late for the checks that protect streamed output.

## Proposed change

Implement the versioned application-owned prompt and the incremental output admission strategy selected by #454. Require supplied facts only, concise English, preserved numbers, and confidence/uncertainty grounded in engine reasons. Add bounded length, unexpected-formatting, unknown-number, empty-output, and malformed-output handling, including valid numeric card names. Expose accepted text and rejection outcomes to the runtime/session without embedding a second recommendation engine. Document the semantic limits of mechanical checks.

## Acceptance Criteria

- [ ] AC1: Corpus evaluation confirms the prompt expresses all PRD factuality/prose constraints and uses only #452 facts.
- [ ] AC2: Output-boundary tests reject unsupplied numeric claims, prohibited formatting, excessive output, and empty completions while accepting valid names and metrics.
- [ ] AC3: Chunk-boundary tests show an unsafe numeric/format sequence split across tokens is not admitted merely because individual tokens appear harmless.
- [ ] AC4: A streamed corpus experiment produces progressive admitted text under the #454 policy and records rejection/fallback behavior without claiming semantic certainty from mechanical validation.
- [ ] AC5: Prompt/policy version changes are identifiable in evaluation results and can be compared against the fixed corpus; verified by a versioned evaluation run.

## Implementation classification

- **Estimated size:** M
- **Orchestration risk:** High
- **Reason:** Streaming and factual admission interact at boundaries ordinary happy-path tests miss.

## Dependencies

Direct prerequisites: #454. Consumer: Run bounded local narration in a reusable worker.

贡献指南

这个仓库没有索引到贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。