microsoft / microsoft/DCVC

performance drop when fintunning DMC model from ACMMM2022

Open
#2 9 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
829
Forks
138
Avg merge
1d 2h
Merged PRs (30d)
1

Description

Congratulations on such remarkable results that surpass VVC!

I ran the test code with the pre-trained model you provided and I reproduced the results you reported in the paper.

Unluckily, when I tried to finetune it for some steps following the training strategy (lr=1e-5, multi-frame forward loss averaging) in (sheng et al2021), the RD curve will drop around 0.7 dB after just hundreds of steps.

The training code is based on DVC and the regular rate-distortion loss is optimized.

Any suggestions will be appreciated.

Thank you!

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the DMC test and training code, the provided pre-trained model, and the referenced Sheng et al. 2021 strategy. Reproduce fine-tuning with lr=1e-5, multi-frame forward loss averaging, and the regular rate-distortion loss, then determine why the RD curve drops and document or correct the cause.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.