a2ui-project / a2ui-project/a2ui
[FEATURE]: Add initial conformance tests to the a2ui core SDK
- Dominant language
- TypeScript
- Stars
- 16.4k
- Forks
- 1.3k
- Avg merge
- 3d 15h
- Merged PRs (30d)
- 134
Description
The agent SDK currently has platform agnostic conformance tests.
We should add similar conformance tests to the core framework.
Let's start by adding a suite for the data model, e.g. conforming that updateing the data model at different paths etc should work correctly for all edge cases.
This can replace the existing unit tests for the data model in many cases.
1. Research how the framework currently works for the agent SDK
2. Plan how to translate that to the core SDK, including where it should be described in blueprints and readmes etc so that coding agents can discover and manage it. perhaps there should be a skill explaining how our conformance tests work overall. We may want to do some changes to repo structure, e.g. add a /conformance folder with the conformance test definitions and YAML sources of truth
3. Define some tests cases for data model in the core SDK
4. Hook up the conformance tests to the Python and TS data model implementations for now
Please come up with detailed plan for all of this before doing the implementation.
Contributor guide
Research direction
Examine the agent SDK's existing conformance tests to understand their structure. Plan how to adapt them for the core SDK's data model, considering where to place definitions in a /conformance folder and how to integrate with Python and TypeScript implementations. The work involves research, architectural planning, and test definition before implementation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, typescript
- Domain
- testing, tooling
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100