Autopilot task-completion enforcement can override explicit user instructions
Chưa có ai nhận issue này.
- Ngôn ngữ chính
- Shell
- Star
- 11.2k
- Fork
- 1.9k
- Merge trung bình
- 14 giờ 16 phút
- Pull request đã merge (30 ngày)
- 6
Mô tả
Describe the bug
In Copilot CLI autopilot mode, the task-completion enforcement behavior can cause the agent to continue taking action after the user has explicitly narrowed the task to research/explanation only.
In my case, the user explicitly instructed the agent to do nothing besides respond and asked for an explanation/research task. After the agent answered, a follow-up enforcement message appeared:
“You have not yet marked the task as complete using the task_complete tool. If you were planning, stop planning and start implementing.”
That message appears to push the agent toward implementation/action even when the active user request is intentionally non-implementation work.
Why this is a problem
This can lead to the agent making unintended workspace changes despite the user explicitly asking for diagnostic or explanatory help only. The issue is especially risky because the enforcement message is framed as higher-priority continuation guidance, so the agent may treat it as expanding the user’s requested scope.
Suggested improvement
Adjust the completion enforcement prompt/logic so it preserves the current user’s scope constraints. For example:
- If the user asks for research/explanation only, completing the answer should be considered sufficient.
- If the user explicitly says not to modify files or take action, the continuation message should not direct the agent to “start implementing.”
- The agent should be encouraged to call
task_completewith a concise summary when the requested non-code task is complete.
Notes
This may be related to autopilot/task-completion behavior introduced or changed recently. The problematic phrase above is included because it seems useful for locating the relevant enforcement path.
Affected version
GitHub Copilot CLI 1.0.77.
Steps to reproduce the behavior
- Start a Copilot CLI session with autopilot mode enabled.
- Ask for a research-only or explanation-only task, and explicitly prohibit action. For example:
Please help me understand this behavior. Do not edit files, run implementation steps, or make changes. Just explain what is happening.
- Let the agent provide a complete explanatory answer without calling
task_complete. - Observe that task-completion enforcement sends a follow-up message similar to:
“You have not yet marked the task as complete using the task_complete tool. If you were planning, stop planning and start implementing.”
- Observe that the agent may interpret this as a directive to take implementation/action-oriented steps, despite the user’s explicit “do not act” instruction.
Expected behavior
If the active user request is clearly research-only, explanation-only, or explicitly says not to modify anything, task-completion enforcement should allow the agent to finish by calling task_complete with a research summary, rather than nudging it toward implementation.
At minimum, the enforcement text should not say “start implementing” when the current task has no implementation component or when the user has explicitly prohibited changes.
Actual behavior
The agent was nudged to continue with implementation-oriented behavior after completing an explanatory/research response, despite the user saying to do nothing except respond.
Additional context
- Copilot CLI: 1.0.77
- Mode: autopilot enabled
- OS: Linux devcontainer
- Shell: bash
- Terminal emulator: Herdr-managed terminal session
Hướng dẫn đóng góp
Bắt đầu từ đâu
- Đọc hết issue, rồi đọc hướng dẫn đóng góp của dự án.
- Bình luận trên issue rằng bạn sẽ nhận — tránh hai người làm cùng một việc.
- Fork repository và làm thay đổi trên một nhánh.
- Mở pull request có tham chiếu số hiệu của issue.
Hướng nghiên cứu
Tìm kiếm trong repository thông báo được trích dẫn “start implementing” và đường dẫn enforcement của autopilot/task-completion, sau đó tái hiện hành vi bằng các bước chỉ dành cho nghiên cứu trong issue. Hoàn tất có nghĩa là một yêu cầu chỉ cần giải thích có thể kết thúc bằng bản tóm tắt task_complete mà không nhận hướng dẫn thiên về triển khai hoặc gây ra hành động trái với các ràng buộc rõ ràng của người dùng.
Do mô hình lập chỉ mục viết ra từ nội dung của issue.
Đánh giá
- Công nghệ
- shell
- Lĩnh vực
- ai, cli
- Loại issue
- Lỗi
- Độ khó
- 4/5
- Thời gian dự kiến
- 3-5 ngày
- Mức độ hoạt động
- Ít trao đổi
- Độ rõ ràng
- Khá rõ ràng
- Mức phù hợp với người mới
- 45/100