huggingface / huggingface/pytorch-image-models

[FEATURE] Validation labels txt or csv file

Open
#1,081 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
37.1k
Forks
5.2k
Avg merge
1d 13h
Merged PRs (30d)
34

Description

I have trained model using timm distributed_train.sh, but I have 0.1 validation accuracy on imagenet. Images in validation folder are all placed in root directory going like `ILSVRC2012_val_00000001.JPEG ... ILSVRC2012_val_00050000.JPEG`.

**Describe the solution you'd like**
I would like to have parameter in `validate.py` file similar to `'--real-labels'` that will take csv or txt file with structure like
```
ImageId,Class
ILSVRC2012_val_00000001,n01751748
```

Contributor guide

Open the contributing guide

Research direction

Start in validate.py by reading the existing --real-labels handling and how validation image paths are resolved; distributed_train.sh provides the training context. Check how the requested CSV or TXT ImageId/Class mapping should connect to the root-level ImageNet validation filenames, and consider the feature complete when validation accepts that mapping and produces usable accuracy results.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.