Megvii-BaseDetection / Megvii-BaseDetection/LLA

Results on cityperson dataset

Open
#2 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
36
Forks
3
PR merge metrics
No merged PRs in 30d

Description

Hi, thanks for sharing this excellent work! I have a question about the results on cityperson dataset. I trained the ATSS model on cityperson dataset and test on it with the code provided in cvpods/data/datasets/citypersons.py. I followed the same training setting as in Crowdhuman, as described in your paper. However I got unsatisfactory results (0.27 MR-2 on reasonable subset and 0.571 on HO subset) which has a huge gap with the results report in your paper. Do I miss something important? the config setting is as following:

image
image
image

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with cvpods/data/datasets/citypersons.py and compare the configuration shown in the issue with the Crowdhuman training setting and the paper's reported setup. Reproduce the CityPersons evaluation and investigate the gap between the reported MR-2 values on the reasonable and HO subsets. Done means identifying the missing setting or documenting why the results differ.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
computer-vision, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.