a2ui-project / a2ui-project/a2ui

[FEATURE]: Add platform-agnostic conformance tests for a2ui-core libraries.

未关闭
#2,028 1 条评论 0 个 reaction 已指派 1 人 已被 @Varun-S10 认领 在 GitHub 查看
P2 status: waiting-for-author-response
主要语言
TypeScript
星标
16.4k
派生
1.3k
平均合并
2 天 13 小时
30 天内合并 PR
134

描述

Currently, our inference libraries have conformance tests for some features, which verify inputs and outputs. The expected inputs and outputs are encoded in YAML, with a description of how the test rig should be configured to use them.

We should do the same thing for the core libraries. e.g. to verify:
- Processing of messages is correct
- State of models is updated correctly - e.g. surfaceModel, componentModel etc, but also the node tree once it's implemented.
- The expected errors are emitted correctly
- Data model lookups work as expected with paths etc
- Functions work as expected, including nesting, functions that expose streams of data from the client etc.

This would go a long way towards making sure our libraries are consistent with each other.

贡献指南

打开贡献指南

调研方向

Look at existing conformance tests for inference libraries to understand the YAML format and test rig configuration. Examine core libraries like surfaceModel and componentModel to identify key behaviors to test. The goal is to create tests that verify message processing, state updates, error emission, data model lookups, and function behavior across libraries.

由索引模型根据 Issue 内容生成。

评估

技术栈
typescript, yaml
领域
testing
Issue 类型
功能
难度
4/5
预计耗时
3-5 天
活跃度
冷清
描述清晰度
基本清楚
新手友好度
45/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。