awslabs / awslabs/agent-evaluation
Add exceptions to trace
Open
enhancement
- Dominant language
- Python
- Stars
- 372
- Forks
- 51
- PR merge metrics
- No merged PRs in 30d
Description
Currently, exceptions are not recorded in the evaluator trace. This should be added for completeness.
Contributor guide
Research direction
Start by locating the evaluator trace implementation and the code path that handles exceptions. Determine how exceptions should appear in the trace and add coverage for that behavior. Done means evaluator traces record exceptions consistently with other events.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, testing
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100