awslabs / awslabs/agent-evaluation

Global test cases

Open
#31 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
372
Forks
51
PR merge metrics
No merged PRs in 30d

Description

Enable global tests which can be applied to all test cases.

Contributor guide

Open the contributing guide

Research direction

The issue names no files, tests, or entry points. First map how test cases are defined and executed in this Python framework, then clarify how global tests should be configured and applied. Done means a documented, agreed behavior exists for applying the global tests to every test case.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.