AB-Law / AB-Law/Vett

Implement planner-executor-critic scoring pipeline

未关闭
#3 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
enhancement
主要语言
Python
星标
0
派生
0
PR 合并指标
30 天内没有已合并 PR

描述

Problem
Current scoring is a one-shot model step that outputs score schema, missing-signal data, and recommendations in a single pass. This allows malformed JSON and logical inconsistencies to pass through unchecked.

Impact
Unstable local model outputs reduce trust, can break downstream consumers, and make missing-signal interpretation unreliable. Contradictions such as mismatched missing keywords and gap analysis can silently appear in scored outputs.

Proposed Fix
Introduce a 3-stage local loop: Stage 1 Planner proposes the score schema and missing-signal hypotheses. Stage 2 Executor generates score and recommendations based on the planner output. Stage 3 Critic validates JSON shape and contradiction rules (for example, skills listed in missing_keywords must exist in gap_analysis and vice versa), and can request one corrective retry when validation fails.

Functionality Impact
Scoring becomes more deterministic and self-correcting, with more stable and trustworthy outputs. The loop adds an extra model/validation cycle and slight latency increase, but should reduce malformed payloads and improve downstream reliability.

贡献指南

这个仓库没有索引到贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。