iterative / iterative/studio-support

Unexpected behavior of live metrics, params and plots when using a custom directory.

Open
#97 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
No language data
Stars
17
Forks
1
PR merge metrics
No merged PRs in 30d

Description

When importing a repo using a custom directory (`model_training`), the columns and plots in live experiments include the custom directory prefix. In completed experiments and/or commits, the names appear without the prefix:

![image](https://github.com/iterative/studio-support/assets/12677733/592ad5d9-4602-4a03-ac0d-616d9ab94b55)

![image](https://github.com/iterative/studio-support/assets/12677733/82505dc5-6c01-4790-937e-0f6da216a1ff)

Metrics, params, and plots that are outside the selected slice also appear in live experiments (`dataset_creation/params.yaml` in the screenshot).

Reproduction repo:

https://github.com/daavoo/debug-missing-metrics

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.