codeforboston / codeforboston/maple

Hearing Transcription Pipeline

Open
#1,840 0 comments 0 reactions 0 assignees View on GitHub
backend needs scope Transcriptions
Dominant language
TypeScript
Stars
56
Forks
175
Avg merge
2d 5h
Merged PRs (30d)
13

Description

## Problem

We have put work into developing a way to take Hearing Transcriptions generated by AssemblyAI and generate summaries of them. We now want to connect this work into the web flow so that we can automatically generate summaries for new transcriptions.

## Success Criteria
- [ ] All newly generated transcriptions should be automatically passed to this function (by a firebase function document trigger, either in Python directly or in Typescript using the ML Wrapper API)
- [ ] Depending on which transcription fields we need, we might need to modify the hearing transcription flow slightly (because we save the individual `paragraphs` breakdown` separately from the transcriptions themselves, which could be a problem if we need those to generate the summary).
- [ ] Backfill script to generate summaries for all pre-existing transcriptions that do not have one

## Blockers
- The ML Wrapper API isn't available yet, so there may be a blocker on that before we can launch the pipeline part of this
- We also still need to do codebase splitting for Firebase Functions, which requires a bit of care to deploy - the work here isn't complicated, but it will require renaming existing functions to support typescript and python functions in the same project, which is non-trivial in Firebase.
- Before we can backfill, we also need to run the backfill for the hearing transcriptions themselves, which is yet to be written.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.