meta-pytorch / meta-pytorch/data
[Adapters] DataLoaderV2 Adapters Ideas
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.3k
- Forks
- 179
- Avg merge
- 6d 1h
- Merged PRs (30d)
- 2
Description
Motivation, pitch
As we are growing product there are more and more adapters ideas and requests coming up. This issue created to aggregate such requests and keep track of duplications.
🚀 The feature
- Add
Collate(fn)Adapter which will add.collate(fn)DataPipe at the end of the graph. Optional: we can think about overriding existing collate in the graph for new function. -
Shuffle -
PinMemory
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the DataLoaderV2 adapter entry points and reviewing how existing adapters, including Shuffle, are represented. Clarify whether the goal is Collate, PinMemory, or another request, then define the expected behavior and completion checks for the selected adapter.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- data
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100