meta-pytorch / meta-pytorch/data
best practice for `snapshot_every_n_steps`
Open
@andrewkho is already working on this.
Since Jul 8, 2024.
documentation
- Dominant language
- Python
- Stars
- 1.3k
- Forks
- 179
- Avg merge
- 6d 1h
- Merged PRs (30d)
- 2
Description
Hello,
Thank you for your awesome implementation of StatefulDataloader.
I have a question about snapshot_every_n_steps. It seems there is not much detailed explanation about this argument.
- Will frequent snapshots (i.e.,
snapshot_every_n_steps=1) cause a data loading burden? - What is the best practice for setting this value? Is it related to checkpointing frequency?
cc @andrewkho
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.