AltimateAI / AltimateAI/altimate-code
Constrained tool-call decoding: validate (local vLLM) + wire
- Lingua principale
- TypeScript
- Stelle
- 811
- Fork
- 134
- Merge medio
- 3g 2h
- PR unite (30g)
- 50
Descrizione
### Context
`provider/constrained.ts` (grammar/JSON-Schema constrained decoding for local providers) was split out of #858 so the validated tool-retrieval lever could land clean. Code + unit tests live on branch `feat/constrained-decoding`.
### Work
1. **Validate**: run a local vLLM guided-decoding A/B (constrained ON vs OFF) on a tool-heavy task set; confirm it improves tool-call parse-rate / reduces malformed calls at no quality cost.
2. **Wire**: re-add the flag-gated (`ALTIMATE_CONSTRAINED_TOOLCALLS`, local-providers-only, `toolChoice: "required"`) block into `session/llm.ts` (marker-wrapped).
3. Open the PR once it actually does something measurable.
Do NOT open a PR with the flag wired-but-unvalidated or present-but-unwired (the no-op-flag anti-pattern). Branch: `feat/constrained-decoding`.
Guida per i contributori
Apri la guida per i contributori
Valutazione
Questa issue non è ancora stata valutata.