epam / epam/ai-dial-admin-evaluation-framework-backend
[Eval] MCP for Evaluation Framework
Open
enhancement
P3 - Medium
- Dominant language
- Java
- Stars
- 3
- Forks
- 1
- Avg merge
- 1d 1h
- Merged PRs (30d)
- 27
Description
Eval MCP should provide the necessary set of tools for llms to be able to define a new dataset populate it with test cases, create a test suite (if requried), run the test suite and fetch results.
Contributor guide
Research direction
Start by reading the issue alongside the Spring Boot service entry points and existing evaluation lifecycle APIs. Map the required MCP operations for dataset creation, test-case population, suite creation, execution, and result retrieval, then clarify the tool contracts and acceptance criteria before implementation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, spring-boot
- Domain
- ai, api, backend
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100