zhanghang1989 / zhanghang1989/PyTorch-Encoding

Training & Finetuning on Custom Data

Open
#372 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
2k
Forks
448
PR merge metrics
No merged PRs in 30d

Description

Hi,

Apologies if this has been asked before.

I have a custom data with ~700 tagged images, total number of classes are 15.

I have trained a model using the following combination (this gives the best results so far);

python train_dist.py --dataset ADE20K --model EncNet --aux --se-loss --backbone resnest101 --epochs XXX

It is giving okay-ish results. I understand the data is too less to expect pretty good results but the classes are rather simple and I cannot afford more data. I want to fine-tune (or maybe overfit) to my custom data for demonstration purpose. But, whatever I try so far, it just doesn't get any better.

Can you suggest any best practices, suggestions on how can I fine-tune to my particularly small data-set?

Thank you!

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names no files, tests, or implementation entry points. Start by reviewing the train_dist.py command and the custom dataset setup described in the report; a useful outcome would need to define and document reliable fine-tuning practices for the small 15-class dataset, but the requested behavior is not specified.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.