microsoft / microsoft/WhatTheHack

[Proposal]: Speech to Text WTH

Open
#528 1 comment 1 reaction 1 assignee View on GitHub

@jrzyshr is already working on this.

Since Mar 23, 2023.

proposal
Dominant language
C#
Stars
1.9k
Forks
886
PR merge metrics
No merged PRs in 30d

Description

Topic

The Speech to Text WTH hack will help hackers understand how to use Azure's Cognitive Speech services. The hack will take call center data and navigate through challenges to learn the tools to transcribe the audio files, improve the accuracy of these transcriptions, determine the intent of the calls, assess sentiment and PII redaction. Finally, we will be able to run the model in their own environment.

Abstract/Learning Objectives
  • Data Cleaning + Preprocess Ground Truth Files
  • Train a standard model
  • Train a custom acoustic model
  • Test and evaluate the accuracy of the models
  • Deploy and containerize the models
Delivery Date

3/10/23

Authors
Lauren Tran , GitHub: laurentran 

Jason Virtue, GitHub: DataSciNAll 

Israel Ekpo, GitHub: izzymsft 

Ellie Nosrat, GitHub: EllieNosrat
Other

Natural Language Processing is a common hero offering by Microsoft. Documentation is limited on how to setup and process audio data (unstructured) and this WTH will help developer readiness. This will be the first WTH on NLP.

Code of Conduct
  • I agree to follow this project's Code of Conduct

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.