Megvii-BaseDetection / Megvii-BaseDetection/YOLOX
It can work on smaller data but throw errors on larger data
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 10.6k
- Forks
- 2.5k
- PR merge metrics
- No merged PRs in 30d
Description
I tried to use 80000~90000 images to train. It works after several attempts. But when I tried to enlarge data to more than 100000 images, it won't work any more and threw errors. The following is the error message:
Runtime Error: Trying to resize storage that is not resizable
RuntimeError: Pin memory thread exited unexpectedly
I have checked all my data. No empty xml files and images are good.
Is there anyone who came across the same problem? How to fix it?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing training with more than 100000 images and capture the reported storage-resize and pin-memory errors. Compare it with the smaller dataset that succeeds, then identify the data-loading path responsible; done means the larger dataset trains without either runtime error.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100