Megvii-BaseDetection / Megvii-BaseDetection/YOLOX

Validation Data, Loss and Overfitting

Open
#837 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
10.6k
Forks
2.5k
PR merge metrics
No merged PRs in 30d

Description

I see during training trainval.txt is used https://github.com/Megvii-BaseDetection/YOLOX/blob/6880e3999eb5cf83037e1818ee63d589384587bd/yolox/data/datasets/voc.py#L105
and after each epoch we evalute the model on test data instead of validation data https://github.com/Megvii-BaseDetection/YOLOX/blob/6880e3999eb5cf83037e1818ee63d589384587bd/exps/example/yolox_voc/yolox_voc_s.py#L104 I mean if i am training the model and I need to check if it is overfitting or not, how can I decide. May be I am wrong if this is not the way done in YOLOX. Actually I am doing some data sampling strategy but only on train data and I want to see if it is over-fitting the model or not.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with yolox/data/datasets/voc.py around line 105 and exps/example/yolox_voc/yolox_voc_s.py around line 104, then trace how trainval.txt and test data are selected during training and evaluation. Run the VOC training and evaluation flow to verify whether test data is used for per-epoch evaluation. Done means the intended validation behavior and its effect on checking overfitting are established.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.