meta-pytorch / meta-pytorch/data
TorchText tests failed when multiprocessing
Open
@NivekT is already working on this.
Since May 11, 2022.
high priority
- Dominant language
- Python
- Stars
- 1.3k
- Forks
- 179
- Avg merge
- 6d 1h
- Merged PRs (30d)
- 2
Description
🐛 Describe the bug
I think the test from TorchText starts failing after https://github.com/pytorch/pytorch/pull/74984 is landed into core and shipped into nightly.
Should we either revert the change or fix this problem ASAP considering the closing branch cut for TorchText?
We can let TorchText team to remove all lambda function in their dataset if needed.
Versions
main
Progress
- Replacing lambda usages in TorchText
https://github.com/pytorch/text/pull/1718 - Add ability to use
dillin DataLoaderV1
https://github.com/pytorch/pytorch/pull/77288 - Add ability to use
dillin DataLoaderV2 (TODO)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.