[Observation]: Copilot SDK 1.0.x is less willing to load skills
- Lenguaje dominante
- Java
- Estrellas
- 10.5k
- Forks
- 1.5k
- Merge medio
- 1 d 11 h
- PR fusionados (30 d)
- 127
Descripción
My team has recently upgraded Copilot SDK from 0.3.x to 1.0.x for running a few fixed scenarios to track the agent behavior with our skills. We give the agent a generic documentation tool that searches in MS Learn and skills with service oriented instructions. We noticed that after upgrading to Copilot SDK 1.0.x, the agent shows a much higher likelihood to use documentation tools instead of loading a skill. This is not an ideal behavior. Local skills are usually knowledge the user creates to override the generic knowledge in the training data or public documentation. They are also usually more efficient in token usage.
Guía de contribución
Línea de trabajo
No files, tests, or entry points are named. Start by reproducing the fixed scenarios across Copilot SDK 0.3.x and 1.0.x with the MS Learn documentation tool and local skills, then determine when skill loading is bypassed. Done would require an agreed expected precedence and a concrete location for validating or changing that behavior.
Escrito por el modelo de indexación a partir del texto del issue.
Evaluación
- Área
- ai
- Tipo de issue
- Error
- Dificultad
- 5/5
- Tiempo estimado
- Más de una semana
- Estado de actividad
- Tranquilo
- Claridad
- Necesita aclaración
- Aptitud para principiantes
- 35/100