Document authoritative Developer Info contract for tool-call evaluation
Nobody has claimed this yet.
- Dominant language
- PowerShell
- Stars
- 1k
- Forks
- 132
- Avg merge
- 5d 19h
- Merged PRs (30d)
- 6
Description
Context
M365-Copilot-Agent-Evals PR https://github.com/microsoft/M365-Copilot-Agent-Evals/pull/431 depends on an authoritative WorkIQ contract for application/vnd.ms-workiq.developer-info. The current developer-info.md is marked Proposal and not yet implemented.
Related Evals issues: https://github.com/microsoft/M365-Copilot-Agent-Evals/issues/224 and https://github.com/microsoft/M365-Copilot-Agent-Evals/issues/280.
Required contract
- Accepted media type and AgentCard/
accepted_output_modesactivation - A2A message/send and message/stream accumulation semantics across artifact updates
- Append/replace/patch, ordering, deduplication, and conflict rules
- Terminal behavior proving Developer Info is complete for a turn
- Conversation/request/turn correlation invariants
- Canonical nested
DeveloperInfo.plugins.executions[]structure - Canonical tool naming, case sensitivity, uniqueness, and stability invariants
tool_call_id, attempt identity, parent/logical-call identity, and retry correlation- Which selected, attempted, failed, canceled, interrupted, and auth-required executions are emitted
- Authoritative successful/failed/indeterminate execution outcome algorithm
Acceptance criteria
- Publish the finalized contract in the owned WorkIQ documentation.
- Add conformance examples for single call, multiple calls, failed call, retry-success, and multi-frame streaming.
- Identify the implementation/rollout status consumers can use to gate support.
- Link the finalized document back to PR #431.
This issue is an approval dependency for PR #431, not an informal follow-up.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the current developer-info.md and review PR #431, then consult related Evals issues #224 and #280. Done means the owned WorkIQ documentation contains the finalized contract, conformance examples for the listed call and streaming cases, consumer-facing implementation or rollout status, and a link back to PR #431.
Written by the indexing model from the issue text.
Assessment
- Domain
- api, documentation
- Issue type
- Documentation
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Clearly specified
- Newbie friendliness
- 35/100