a2ui-project / a2ui-project/a2ui

[FEATURE]: Add initial conformance tests to the a2ui core SDK

Open
#2,150 3 comments 0 reactions 1 assignee Claimed by @jacobsimionato View on GitHub
P1 status: needs-team-input
Dominant language
TypeScript
Stars
16.4k
Forks
1.3k
Avg merge
3d 15h
Merged PRs (30d)
134

Description

The agent SDK currently has platform agnostic conformance tests.

We should add similar conformance tests to the core framework.

Let's start by adding a suite for the data model, e.g. conforming that updateing the data model at different paths etc should work correctly for all edge cases.

This can replace the existing unit tests for the data model in many cases.

1. Research how the framework currently works for the agent SDK
2. Plan how to translate that to the core SDK, including where it should be described in blueprints and readmes etc so that coding agents can discover and manage it. perhaps there should be a skill explaining how our conformance tests work overall. We may want to do some changes to repo structure, e.g. add a /conformance folder with the conformance test definitions and YAML sources of truth
3. Define some tests cases for data model in the core SDK
4. Hook up the conformance tests to the Python and TS data model implementations for now

Please come up with detailed plan for all of this before doing the implementation.

Contributor guide

Open the contributing guide

Research direction

Examine the agent SDK's existing conformance tests to understand their structure. Plan how to adapt them for the core SDK's data model, considering where to place definitions in a /conformance folder and how to integrate with Python and TypeScript implementations. The work involves research, architectural planning, and test definition before implementation.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, typescript
Domain
testing, tooling
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.