w3c / w3c/webcodecs

Announcement: Background Segmentation metadata entry to WebCodecs VideoFrame Metadata Registry

Open
#800 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
HTML
Stars
1.3k
Forks
194
Avg merge
1d 13h
Merged PRs (30d)
3

Description

As per requirement of the VideoFrame Metadata Registry, this issue has been filed to allow discussion about the Background Segmentation MASK metadata on being added into VideoFrameMetadata dictionary. The proposal is in the https://github.com/w3c/mediacapture-extensions/pull/142

Suggested by @jan-ivar here.
@aboba touched upon this here

In many cases, it might be important to have access to the original camera feed, so BG MASK retains the original frames intact, does segmentation and provides mask frames in addition to the original video frames thus web applications receive both the original frames and mask data.

Explainer

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the VideoFrame Metadata Registry and the VideoFrameMetadata dictionary referenced in the issue, then read mediacapture-extensions PR 142 and the linked background-blur explainer. Done means the proposal has reached a decision and the agreed metadata addition is reflected in the relevant WebCodecs specification or registry.

Written by the indexing model from the issue text.

Assessment

Tech stack
html
Domain
api, computer-vision
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.