AltimateAI / AltimateAI/altimate-code

Constrained tool-call decoding: validate (local vLLM) + wire

Aberta
#868 0 comentários 0 reações 0 responsáveis Ver no GitHub
Linguagem predominante
TypeScript
Estrelas
811
Forks
134
Merge médio
3d 2h
PRs com merge (30d)
50

Descrição

### Context

`provider/constrained.ts` (grammar/JSON-Schema constrained decoding for local providers) was split out of #858 so the validated tool-retrieval lever could land clean. Code + unit tests live on branch `feat/constrained-decoding`.

### Work

1. **Validate**: run a local vLLM guided-decoding A/B (constrained ON vs OFF) on a tool-heavy task set; confirm it improves tool-call parse-rate / reduces malformed calls at no quality cost.
2. **Wire**: re-add the flag-gated (`ALTIMATE_CONSTRAINED_TOOLCALLS`, local-providers-only, `toolChoice: "required"`) block into `session/llm.ts` (marker-wrapped).
3. Open the PR once it actually does something measurable.

Do NOT open a PR with the flag wired-but-unvalidated or present-but-unwired (the no-op-flag anti-pattern). Branch: `feat/constrained-decoding`.

Guia de contribuição

Abrir o guia de contribuição

Avaliação

Esta issue ainda não foi avaliada.

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.