facebookresearch / facebookresearch/dora

Deleting History of a Cancelled Experiment

Open
#65 1 comment 0 reactions 0 assignees View on GitHub
question
Dominant language
Python
Stars
314
Forks
25
PR merge metrics
No merged PRs in 30d

Description

## ❓ Questions

Hi @adefossez,

Thank you for developing such a useful package. I have encountered an issue with rerunning a cancelled experiment (XP). Specifically, I'm using dora grid baseline --clear with the expectation that the experiment would start from scratch. Initially, it appears to work as the history.json file is deleted. However, as the process continues, the previous history reappears before the current training starts, causing the training to resume from the last cancellation point.

This issue does not occur if the previous experiment completes successfully; in those cases, the --clear option works as expected. Could you advise on how to ensure that a cancelled experiment restarts completely from scratch when rerun?

Thank you for your assistance.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.