AgentEvaluation/NHD

View on GitHub

Evaluate your AI agents

Stars: 51
Forks: 6
Open beginner issues: 0
Indexed issues: 18

Dominant language: TypeScript
License: MIT
Last GitHub push: May 24, 2025
Latest indexed: Sep 13, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue
PR merge metrics: No merged PRs in 30d

Open All

18 open issues indexed

Conversation shows "Pass" even if metrics have failed Open

AgentEvaluation/NHD#91 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 13, 2026
Test conversation seems to restart (without this being mentioned in test description) Open

AgentEvaluation/NHD#92 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 13, 2026
[USABILITY] There should be an option to initiate Run from the scenarios page. User loses context of selected personas when you navigate to new Runs Page Open

AgentEvaluation/NHD#93 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Misaligned size for "Load Saved Agent" Dropdown in Configuration Page Open

good first issue

AgentEvaluation/NHD#96 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Delete button in personas tab not working Open

AgentEvaluation/NHD#99 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Delete/ Multi-select options missing on selecting multiple agents in Scenarios page Open

enhancement good first issue

AgentEvaluation/NHD#100 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Save/Update button issue in Config page Open

good first issue

AgentEvaluation/NHD#103 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Progress indication / usage indication of "Done" button unclear Open

AgentEvaluation/NHD#104 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Indicator needed to show a "Run" is in progress Open

good first issue mentorship available

AgentEvaluation/NHD#106 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
[Potential CX Suggestion] Show an estimate of token consumption before the run + show tokens consumed after run is complete Open

AgentEvaluation/NHD#107 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Details about the types of metrics Open

AgentEvaluation/NHD#108 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Add mandatory fields and corresponding validation while creating persona Open

good first issue

AgentEvaluation/NHD#109 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
[Good to have] Multi-select option for personas Open

good first issue

AgentEvaluation/NHD#110 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Agent is not playing out the test scenarios that are created manually Open

AgentEvaluation/NHD#111 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Updating standard personas using Edit button is not working Open

AgentEvaluation/NHD#112 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 13, 2026
Option to rerun a specific test that failed Open

AgentEvaluation/NHD#114 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
[TBD] If there are conflicting emotions in persona versus the test - priority needs to be assigned Open

AgentEvaluation/NHD#115 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Option to manually add tests *missing* until I generate scenarios Open

good first issue

AgentEvaluation/NHD#118 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026

AgentEvaluation/NHD

Get new issues in your inbox