Azure / Azure/azure-dev

[evals] tracking issue for a solution for storing and analyzing vally runs

Open
#9,343 1 comment 0 reactions 1 assignee Claimed by @richardpark-msft View on GitHub
area/evals engineering item upstream deps
Dominant language
Go
Stars
569
Forks
364
Avg merge
2d 19h
Merged PRs (30d)
136

Description

Our azd eval work uses Vally, but we do not have a solution for storing results across runs and analyzing trends, statistics, and regressions. There are a few internal projects, but we'd prefer to to use a vally supported output so we can analyze for trends, and keep track of some basic metrics like whether tests are consistently passing, etc...

There is an issue for this in vally, so this issue is just to provide a placeholder we can use in our planning:

"Support pluggable vally ingest destinations beyond SQLite (e.g. Kusto/ADX)"
* microsoft/vally#575: https://github.com/microsoft/vally/issues/575

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.