github / github/app

Auto model picker is not adhering to tool usage.

Open
#3,508 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
No language data
Stars
2.1k
Forks
157
PR merge metrics
No merged PRs in 30d

Description

Auto model picker is not adhering to tool usage. Suggest either stronger triage model or updating routing. Auto produces a lot of "on it" with no action or "proceeding now"...


Field Value
App version 1.1.14
OS Windows 10.0.22631
Theme Fox
Path /chat
Tenure Day 1

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start at the /chat flow in app version 1.1.14 and reproduce the issue with the auto model picker on Windows 10. Compare requests that require tool use with responses such as “on it” or “proceeding now”; done means the selected routing reliably leads to the requested action rather than only a progress message.

Written by the indexing model from the issue text.

Assessment

Domain
ai, desktop
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.