microsoftgraph / microsoftgraph/microsoft-graph-comms-samples

Writing an image back to the Huebot sample

Open
#418 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
No language data
Stars
253
Forks
275
Avg merge
1d 5h
Merged PRs (30d)
1

Description

Hi there, I've been using the Huebot sample to understand how to work with the Teams video stream.
I've been able to understand the flows of joining the call, subscribing to the dominant speaker, et al. It's pretty straightforward in the sample. Since there's a screenshot feature, I thought I'd like to have the bot display a text overlay on the main speaker.
I've been able to add the text to a bmp created from the current frame using the MediaUtils.TransformNv12ToBmpFaster method.
But I don't know how to re-introduce that image back to the stream, given that (and I'm new to this, so wrongness is expected) the image format is BMP and the stream is expecting NV12.
As I shared on this Stackoverflow question, the best I've gotten is weird looking output.

How do I add an image back to the stream?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the Huebot sample and the MediaUtils.TransformNv12ToBmpFaster call mentioned in the issue; no file or test is named. Identify the supported path for adding the overlaid image back to the Teams video stream, and consider the result complete when the stream displays the overlay without malformed output.

Written by the indexing model from the issue text.

Assessment

Tech stack
csharp
Domain
audio-video-rtc
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.