w3c / w3c/webcodecs

WebCodec as pass through to application metadata

Open
#189 11 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

CR Blocking extension TPAC 2022 TPAC2024
Dominant language
HTML
Stars
1.3k
Forks
194
Avg merge
1d 13h
Merged PRs (30d)
3

Description

This issues stems from https://github.com/w3c/mediacapture-transform/issues/3.
It might be good to have some application specific metadata be passed through without any change through encoder or decoder.
As an example, WebRTC encoded transforms could be used to retrieve some metadata, set them in encoded frame, (like head position or some other info). On the decoded frame, having the same metadata could be useful for JS-based post processing.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading the linked mediacapture-transform issue and the WebRTC encoded-transform example described here. Clarify which application metadata must survive encoding and decoding, how it should appear on encoded and decoded frames, and what interoperable behavior would define completion.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript
Domain
api, audio-video-rtc
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.