OCR based transcription
Nobody has claimed this yet.
- Dominant language
- No language data
- Stars
- 1.1k
- Forks
- 108
- PR merge metrics
- No merged PRs in 30d
Description
Describe the solution you'd like
It would be amazing if you can add a feature of transcribing videos based on hard-coded subtitles. The feature would use OCR to match timestamps more closely to your hard-coded subtitles instead of Whisper.
Describe alternatives you've considered
Currently the best way to do it, which is not accurate, is to use VideSubFinder to create images of the hard-coded subtitles and then import them to Subtitle Edit to extract the text from them. Though it is not accurate and need a lot of human interference.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing how MemoAI currently uses Whisper for transcription and compare that flow with the VideSubFinder and Subtitle Edit workflow described in the issue. Define how hard-coded subtitle text and timestamps should be extracted and matched, then verify that the OCR-based result reduces manual correction while preserving accurate timing.
Written by the indexing model from the issue text.
Assessment
- Domain
- computer-vision
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100