CKGrafico / CKGrafico/chat-copilot

[Stretch] Add language auto-detection for transcription

Open
#34 0 comments 0 reactions 0 assignees View on GitHub
ai feature p2-normal
Dominant language
TypeScript
Stars
0
Forks
0
PR merge metrics
No merged PRs in 30d

Description

**Why:** Users may share audios in different languages; auto-detect instead of manual selection.

**What to build:** Use Transformers.js language detection model (e.g., facebook/mms-lid) to identify audio language before transcription. Pass detected language to Whisper. Show detected language in UI for user confirmation.

**Acceptance criteria:**
- [ ] Language detection model loaded (e.g., facebook/mms-lid)
- [ ] Model runs on audio before transcription
- [ ] Detected language passed to Whisper transcribeAudio capability
- [ ] UI shows "Detected: Spanish" with option to override
- [ ] Fallback to profile language if detection fails
- [ ] Test with multi-language audio samples

**Depends on:** #13

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the implementation and interface established by dependency #13, especially the transcribeAudio capability. Trace where audio reaches transcription, then identify the Transformers.js integration point, the UI language-selection flow, and existing test or sample-audio entry points. Done means detection, Whisper language passing, confirmation UI, fallback behavior, and multilingual samples are covered.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
audio-video-rtc, frontend, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.