ampproject / ampproject/amphtml

Automatically caption videos in stories

Open
#24,800 3 comments 0 reactions 0 assignees View on GitHub
Related to: Accessibility Stale Type: Feature Request WG: stories
Dominant language
JavaScript
Stars
14.9k
Forks
4.1k
PR merge metrics
No merged PRs in 30d

Description

We could use an API like Cloud's speech-to-text to automatically provide captions for videos in stories, a la YouTube. We would, of course, default to publisher-specified captions if any are provided.

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are identified in the issue. Start by determining how videos and publisher-specified captions are handled in stories, then evaluate a speech-to-text API integration. Done means story videos receive automatic captions when no publisher captions are provided, while publisher-specified captions remain the default.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript
Domain
accessibility, frontend
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.