microsoft / microsoft/vscode

Add a diarized meeting mode for continuous agent orchestration

Open
#330,397 0 comments 0 reactions 1 assignee Claimed by @meganrogge View on GitHub
dictation feature-request
Dominant language
TypeScript
Stars
193k
Forks
42.4k
PR merge metrics
PR metrics pending

Description

It would be useful to have a meeting-oriented dictation mode that supports speaker diarization and continuously provides meeting context to an agent.

The mode could:

- Keep a raw, append-only transcript containing the speaker, timestamp, and text.
- Automatically send new transcript chunks to a dedicated agent session at regular intervals.
- Let the user provide a prompt describing what the agent should watch for or accomplish during the meeting.
- Have the dedicated session orchestrate work in other sessions instead of doing the work itself, so it remains responsive as new conversation arrives.
- Allow agents to act on discussed items while the meeting is still in progress.

This would be especially valuable for in-person office conversations and meetings, where an agent could continuously follow the discussion, capture action items, investigate questions, and start relevant work without requiring users to manually paste or submit each transcript segment.

Azure AI Speech already demonstrates speaker diarization in its speech-to-text playground, so this may be a useful foundation for the transcription side of the experience.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.