Repeat an experiment
Open
Nobody has claimed this yet.
A: experiments
feature request
p2-medium
- Dominant language
- Python
- Stars
- 15.9k
- Forks
- 1.3k
- PR merge metrics
- No merged PRs in 30d
Description
Sometimes, experiments may fail for some reasons related with external factors and these experiment could have been launched from code using random search grid so that repeating them is not easy. So, it would be handy two functionalities:
- Repeating failed experiments overwriting the appropiate parameters (Data, metrics, etc.)
dvc exp run --failed
- Repeting a experiment overwriting its apropiate parameters giver its name:
dvc exp run -n petete --repeat
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the dvc exp run command entry point and trace how failed experiments and named experiments are currently selected. Define the behavior for --failed and --repeat, including which experiment parameters and outputs are restored, then add coverage showing that each command repeats the intended experiment.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- cli
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100