Asynchronous prefetching
Open
Nobody has claimed this yet.
enhancement
- Dominant language
- C++
- Stars
- 5.8k
- Forks
- 678
- Avg merge
- 3d 1h
- Merged PRs (30d)
- 27
Description
Is this a new feature, an improvement, or a change to existing functionality?
New Feature
How would you describe the priority of this feature request
Nice to have (e.g. Adoption is possible, the feature will enhance the use-case even more).
Please provide a clear description of problem this feature solves
Instantiating the dali dataloader for jax takes a long time, because of prefetching.
Feature Description
It would be nice to have an asynchronous prefetching feature, so I can interleave jitting the model and the prefetching operations.
Describe your ideal solution
Have two function
def start_async_prefetch(self):
def block_till_ready_async_prefetch():
With these two functions, I can control when prefetching happens
Describe any alternatives you have considered
No response
Additional context
No response
Check for duplicates
- I have searched the open bugs/issues and have found no duplicates for this bug report
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.