[Observation]: Copilot SDK 1.0.x is less willing to load skills
- 主要言語
- Java
- スター
- 10.5k
- フォーク
- 1.5k
- 平均マージ
- 1日 11時間
- マージ済み PR(30日)
- 128
説明
My team has recently upgraded Copilot SDK from 0.3.x to 1.0.x for running a few fixed scenarios to track the agent behavior with our skills. We give the agent a generic documentation tool that searches in MS Learn and skills with service oriented instructions. We noticed that after upgrading to Copilot SDK 1.0.x, the agent shows a much higher likelihood to use documentation tools instead of loading a skill. This is not an ideal behavior. Local skills are usually knowledge the user creates to override the generic knowledge in the training data or public documentation. They are also usually more efficient in token usage.
コントリビューションガイド
調査の方向性
No files, tests, or entry points are named. Start by reproducing the fixed scenarios across Copilot SDK 0.3.x and 1.0.x with the MS Learn documentation tool and local skills, then determine when skill loading is bypassed. Done would require an agreed expected precedence and a concrete location for validating or changing that behavior.
索引モデルが issue の本文から書いたものです。
評価
- 領域
- ai
- issue の種類
- バグ
- 難易度
- 5/5
- 見積もり時間
- 1週間以上
- 活発さ
- 静か
- 明瞭さ
- 説明が足りない
- 初心者へのやさしさ
- 35/100