Severe quality degradation issue when using the DCVC-DC Intra model !!!
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 829
- Forks
- 138
- Avg merge
- 1d 2h
- Merged PRs (30d)
- 1
Description
First of all, I want to express my gratitude for releasing both your code and pre-trained model weights for all the settings.
The testing results closely align with the data reported in your paper, particularly regarding the UVG, HEVC-B, and MCL-JCV datasets.
Recently, I conducted tests on the intra model IntraNoAR of DCVC-DC using the provided pre-trained weights (cvpr2023_video_psnr.pth.tar) from this link. My tests involved using images from a different dataset in the RGB color space for research purposes. Unfortunately, during this process, I encountered issues that led to instability in my model during training.
It took some time for me to debug my implementation, and I finally found that the main issue stemmed from the degradation of the I-frame when compressed by your intra model. I didn't update any learnable parameters in the model which means the result should be the same as the pre-trained model you provided.
Here is the result of the degraded compressed image
-
image 1
Degraded image
Ground truth -
image 2
Degraded image
Ground truth -
image 3
Degraded image
Ground truth -
image 4
Degraded image
Ground truth -
image 5
Degraded image
Ground truth -
image 6
Degraded image
Ground truth
All the images above were downloaded from the original video sources of the commonly used training dataset Vimeo90K, accessible via this link.
Could you please test your intra model with the provided images to check for any problems? Additionally, it would be greatly appreciated if you could provide an additional training script for both your intra-frame and inter-frame models.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with IntraNoAR in DCVC-DC/src/models/image_model.py and the checkpoint path in DCVC-DC/checkpoints/download.py. Reproduce the reported compression results using the provided cvpr2023_video_psnr.pth.tar weights and the linked Vimeo90K RGB images. Done means identifying the cause of the degradation, documenting the expected behavior, and clarifying whether additional intra- and inter-frame training scripts are needed.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- computer-vision, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100