ROI-based encoding with CBR/CQP mode
Nobody has claimed this yet.
- Dominant language
- HTML
- Stars
- 1.3k
- Forks
- 194
- Avg merge
- 1d 13h
- Merged PRs (30d)
- 3
Description
A typical video conferencing app may perform video segmentation and apply background replacement or blur, then encode.
If the segmentation mask can be delivered to WebCodecs as the input for ROI-based encoding, encoder can apply improved QP to regions that is not masked, while consuming less bits on masked regions.
For use cases that background image is not user-self-uploaded image, or the background is blurred, delivering the mask end-to-end with such kind of encoding, will help to reduce bandwidth, while not having visual quality impact.
For sending masks in-band, MPEG annotated-region SEI could be an option.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the WebCodecs encoding API and the issue's CBR/CQP and ROI terminology, then investigate how an MPEG annotated-region SEI could carry a segmentation mask. Done means reaching a maintainer-approved design for end-to-end mask delivery and its encoding behavior; the issue names no files or tests to run.
Written by the indexing model from the issue text.
Assessment
- Domain
- audio-video-rtc
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100