zhanghang1989 / zhanghang1989/PyTorch-Encoding
About the Evaluation on Pascal Context
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 2k
- Forks
- 448
- PR merge metrics
- No merged PRs in 30d
Description
I noticed that you illustrate an example with Pascal Context dataset,
python test.py --dataset PContext --model-zoo Encnet_ResNet50_PContext --eval
pixAcc: 0.7838, mIoU: 0.4958: 100%|████████████████████████| 1276/1276 [46:31<00:00, 2.19s/it]
And I check your implementation and find that it seems that you compute the mIoU w/o considering the background classes.
Could you give me a guide about how to deal with the background class as our model is trained over 59 classes?
Thus I am wondering should we change line#19 within file "PyTorch-Encoding/encoding/datasets/pcontext.py"?
class ContextSegmentation(BaseDataset):
BASE_DIR = 'VOCdevkit/VOC2010'
# NUM_CLASS = 59
NUM_CLASS = 60
Besides, I also notice that you pad zero during training, but such padding can introduce extra noises.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the documented python test.py --dataset PContext --model-zoo Encnet_ResNet50_PContext --eval command and inspect PyTorch-Encoding/encoding/datasets/pcontext.py, especially NUM_CLASS. Compare how evaluation handles the background class with the model's 59 classes, then examine the zero padding used during training; done means the class-count and padding behavior are clearly resolved.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- computer-vision, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100