CSAILVision / CSAILVision/semantic-segmentation-pytorch

Mismatch between result message and result image

Open
#263 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.1k
Forks
1.1k
PR merge metrics
No merged PRs in 30d

Description

I made custom dataset that has 3 classes.

And, I trained hrnet model with pretrained weights.
`python train.py --gpus 0,1,2 --cfg config/ade20k-hrnetv2.yaml`

Then, I validated a one image used training.

Output message is `Mean IoU: 1.0000, Accuracy: 100.00%`
![image](https://user-images.githubusercontent.com/33365390/126595512-7474cd3b-078c-4d89-8065-99279cd35367.png)

But, when looking result image, it's not.
![image](https://user-images.githubusercontent.com/33365390/126595730-22e6f7fe-76e1-478b-8556-139b0af464c0.png)

I printed number of pixcel in intersection and union.
And, number of gray pixcel is 12614.
However, it is must be > 1,000,000, considering result image.

![image](https://user-images.githubusercontent.com/33365390/126596232-9ff57453-e1f1-49ca-a088-c4039998016e.png)
`### intersection: [12614 4295 3970] union [12614 4295 3970]`

I have no idea what is problem.

Contributor guide

No contributing guide indexed for this repository

Research direction

Reproduce the validation run from train.py using config/ade20k-hrnetv2.yaml and the reported three-class dataset. Compare the inputs used for Mean IoU and accuracy with the result image and the printed intersection/union counts. Done means identifying why the perfect metrics disagree with the visual output and documenting a reproducible correction or confirmed data issue.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
computer-vision, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.