AltimateAI / AltimateAI/altimate-code

Constrained tool-call decoding: validate (local vLLM) + wire

Abierto
#868 0 comentarios 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
TypeScript
Estrellas
811
Forks
134
Merge medio
3 d 2 h
PR fusionados (30 d)
50

Descripción

### Context

`provider/constrained.ts` (grammar/JSON-Schema constrained decoding for local providers) was split out of #858 so the validated tool-retrieval lever could land clean. Code + unit tests live on branch `feat/constrained-decoding`.

### Work

1. **Validate**: run a local vLLM guided-decoding A/B (constrained ON vs OFF) on a tool-heavy task set; confirm it improves tool-call parse-rate / reduces malformed calls at no quality cost.
2. **Wire**: re-add the flag-gated (`ALTIMATE_CONSTRAINED_TOOLCALLS`, local-providers-only, `toolChoice: "required"`) block into `session/llm.ts` (marker-wrapped).
3. Open the PR once it actually does something measurable.

Do NOT open a PR with the flag wired-but-unvalidated or present-but-unwired (the no-op-flag anti-pattern). Branch: `feat/constrained-decoding`.

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.