github / github/app

Support local model routing with configurable escalation to paid hosted models

オープン
#460 コメント 2 件 リアクション 0 件 担当者 0 名 GitHub で見る
Requests and ideas
主要言語
言語のデータがありません
スター
2.1k
フォーク
153
PR マージ指標
30日以内にマージされた PR はありません

説明

### Feature summary

Add a configurable “Local Auto” or “Auto Customise” mode to the GitHub Copilot app that allows users to route work through local models first, then escalate to hosted or external models only when needed.

### What problem are you trying to solve?

I can currently use local agents with the CLI and VS Code, but I want the same capability in the GitHub Copilot app.

For hobby and OSS projects, routing all agent work through hosted models can become too expensive. Some of my open-source project usage can consume thousands of dollars per month in model costs if everything is handled by hosted services.

I need a way to use local models for work they can handle, and only escalate to paid hosted models when the local model needs help. This is primarily a cost-control and token-usage-management problem.

### Proposed solution

Add local models or local agents to the model selection list in the GitHub Copilot app, alongside the existing GitHub Copilot-hosted models.

In addition, provide an optional “Local Auto” or “Auto Customise” mode where users can configure a service hierarchy for the Copilot orchestrator.

Example hierarchy:

1. Local models
2. OpenAI
3. Anthropic
4. GitHub Copilot-hosted models

The orchestrator should attempt to use services in the configured order and escalate only when required.

Each service should have a configurable escalation sensitivity setting, such as a slider, so users can control how aggressively Copilot moves from local models to paid hosted models.

For paid external providers such as OpenAI and Anthropic, it would also be useful to support:

- Default model selection
- Disable provider when credits expire
- Drag-and-drop ordering in the escalation hierarchy
- Clear visibility of which provider will be used first, next, and last

As a bonus, it would be valuable if GitHub Copilot could route through existing user entitlements for providers such as Claude or Codex, so users can use included tokens across providers as part of their cost-management strategy.

### Workflow impact

This would primarily affect users running GitHub Copilot agents on hobby, OSS, experimental, or high-volume projects where hosted model usage needs to be actively controlled.

It would improve the GitHub Copilot app workflow by letting users keep Copilot as the orchestration surface while controlling cost, latency, privacy, and model capability.

Users could run cheaper or free local models by default, escalate to stronger paid models only when needed, and avoid having to move between the GitHub Copilot app, CLI, VS Code, and separate provider tools just to manage model usage.

The goal is not to avoid using GitHub Copilot-hosted models. The goal is to control when they are used.

### Installation context

_No response_

### Additional context

Image

コントリビューションガイド

コントリビューションガイドを開く

評価

この issue はまだ評価されていません。

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。