Azure / Azure/MachineLearningNotebooks

Long execution times when retrieving hyperdrive results

Open
#1,302 6 comments 1 reaction 1 assignee Claimed by @mx-iao View on GitHub
ADO Hyperdrive product-issue
Dominant language
Jupyter Notebook
Stars
4.4k
Forks
2.6k
PR merge metrics
No merged PRs in 30d

Description

```python
exp = Experiment(ws, 'hyperdrive')
exp_runs = exp.get_runs()
run_id = '#hyperdrive_run_id'
for run in exp_runs:
if run.id == run_id:
break

# this takes quite some time
hyperparams_set = run.get_hyperparameters()
metrics = run.get_metrics()
```

We notice long execution times (of the order of ~5 minutes) when retrieving hyperdrive results (hyperparameter results). We log simple values and some lists during the hyperdrive step execution, which does not have more than 300 child runs. Is this the expected behaviour?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.