Megvii-BaseDetection / Megvii-BaseDetection/YOLOX

It can work on smaller data but throw errors on larger data

Open
#1,731 2 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
10.6k
Forks
2.5k
PR merge metrics
No merged PRs in 30d

Description

I tried to use 80000~90000 images to train. It works after several attempts. But when I tried to enlarge data to more than 100000 images, it won't work any more and threw errors. The following is the error message:

Runtime Error: Trying to resize storage that is not resizable

RuntimeError: Pin memory thread exited unexpectedly

I have checked all my data. No empty xml files and images are good.

Is there anyone who came across the same problem? How to fix it?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing training with more than 100000 images and capture the reported storage-resize and pin-memory errors. Compare it with the smaller dataset that succeeds, then identify the data-loading path responsible; done means the larger dataset trains without either runtime error.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.