demml / demml/opsml

[eval] UI: evaluation metric dashboard

Open
#387 0 comments 0 reactions 0 assignees View on GitHub
enhancement UI
Dominant language
Rust
Stars
40
Forks
3
PR merge metrics
No merged PRs in 30d

Description

Part of #380
Depends on: #385

## What

Dashboard showing historical evaluation runs for a given scenario — with detail view, run comparison, and regression detection.

- List of past eval runs: timestamp, version, pass/fail, key metrics summary
- Run detail view: per-metric breakdown, inputs/outputs sample
- Comparison view: select two runs side-by-side, highlight metric deltas
- Regression indicator: flag runs where metrics regressed beyond a threshold vs prior run
- Data sourced from Scouter via OpsML proxy

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.