Support auto-upgrading model selection when context fills (instead of compaction)
- 主要言語
- Shell
- スター
- 11.2k
- フォーク
- 1.9k
- 平均マージ
- 14時間 16分
- マージ済み PR(30日)
- 6
説明
### Describe the feature or problem you'd like to solve
Some of the models I have access to support multiple context window sizes. I want to start with the smaller context window, then upgrade to the next larger context window size for the same model type instead of compacting when the context fills up.
### Proposed solution
Add a configuration setting with similar placement to "continueOnAutoMode" - instead of triggering on rate limiting and switching to auto model, trigger on full context (which would normally compact) and switch to larger context version of same model if available, only compacting if already on the largest context available for that model.
### Example prompts or workflows
This would allow starting with a smaller context and seamlessly upgrading within the session if needed. Currently if I start with the smaller context and hit the limit, I have to manually switch then additionally prompt to attempt recovery of the context that was lost by compaction.
### Additional context
Under the premium requests model, smaller context was typically half the multiplier of larger context - I'm assuming that AI credits work similarly. If not, and larger context model scales credit usage based on the actual context used instead of the max, then this feature is unnecessary as I can just start with the larger context every time.
コントリビューションガイド
調査の方向性
まず、既存のcontinueOnAutoMode設定と、現在compactionにつながるcontext-fullパスを読みます。同じモデルタイプの、より大きなコンテキストサイズのバリエーションがどのように表現されているかを追跡します。完了条件は、コンテキストを使い切ったときに設定で次に利用可能なサイズを選択でき、最大サイズでのみcompactできることです。
索引モデルが issue の本文から書いたものです。
評価
- 技術スタック
- shell
- 領域
- ai, cli
- issue の種類
- 機能追加
- 難易度
- 5/5
- 見積もり時間
- 1週間以上
- 活発さ
- 静か
- 明瞭さ
- 説明が足りない
- 初心者へのやさしさ
- 35/100