Unity-Technologies / Unity-Technologies/com.unity.webrtc

[REQUEST] Use Media Foundation SDK for hardware accelerated video encode and decode on Windows

Open
#558 5 comments 4 reactions 1 assignee View on GitHub

@karasusan is already working on this.

Since Nov 24, 2021.

enhancement issued
Dominant language
Assembly
Stars
852
Forks
238
PR merge metrics
No merged PRs in 30d

Description

Is your feature request related to a problem? Please describe.
Hardware accelerated decoding on windows is currently unavailable, and based on how it is being implemented, will likely be limited to NVIDIA GPUs only.

Describe the solution you'd like
Rather than directly integrate with vendor SDKs to support hardware accelerated encode/decode, use the Media Foundation SDK from Microsoft, which provides an abstract interface to hardware encoders and decoders, and relies on GPU vendors to enable hardware encode and decode support via their graphics drivers. This will ultimately reduce the development and maintenance burden on Unity by obviating the need to develop specific integrations for each GPU vendor, and will unlock cross-vendor hardware encoding and decoding support all at once.

Describe alternatives you've considered
On Windows, Media Foundation this is the standard way to support hardware acceleration in video applications at the OS level.

Additional context

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.