Azure-Samples / Azure-Samples/sonic-brief

Incompatible File Types and Audio Channels Causing Azure Transcription Service Failures

Open
#17 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
36
Forks
26
PR merge metrics
No merged PRs in 30d

Description

We have encountered an issue where files passed onto the Azure transcription service often fail due to incompatibilities with the file type and audio channels. due to issues with Azure TTS supporting a limited amount of audio formats/Only mono audio files

Source: https://learn.microsoft.com/en-us/dotnet/api/microsoft.cognitiveservices.speech.speechsynthesisoutputformat?view=azure-dotnet

Steps to Reproduce:

- Pass an audio file with incompatible file type or audio channels to the Azure transcription service.
- Observe the failure in the Azure Functions trigger "Invocations"

**Expected Behavior:** The transcription service should successfully process the audio files without failures.

**Actual Behavior:** The transcription service fails to process the audio files due to incompatibilities with the file type and audio channels. For users, it feels like a 50/50 chance that the file will work when uploaded.

**Proposed Solution:** Implement a local conversion of the audio files before they are passed to the Azure transcription service. This conversion should ensure that the file type and audio channels are compatible with the transcription service requirements. Note that Azure TTS only supports mono audio channels.

**Additional Context:** This issue has been affecting our ability to efficiently transcribe audio files, and a local conversion solution would help mitigate these failures.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.