openzim / openzim/python-scraperlib

Video related primitives should be provided in scraperlist

Open
#194 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement question
Dominant language
Python
Stars
31
Forks
27
Avg merge
3d 7h
Merged PRs (30d)
2

Description

We are publishing more and more ZIM files with videos using many different scrapers.

Do do that we mainly:

  • Re-encode videos/audio streams
  • Handle sub-titles
  • Display all of this using video.js

For the moment many of these pieces of video related functions are distributed in different places (in the scraper relying on them).

At least to me, this is:

  • difficult to understand which scraper is at which status related to the development of these pieces of code
  • Fixes will have to be requested/tracked in each scraper
  • Releases are also de-facto made at very different times

I'm not prescriptive about the exact solution, but I believe we should try to consolidate this at one place.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by inventorying the video-related functionality currently distributed across the scrapers that use python-scraperlib, including video/audio re-encoding, subtitles, and video.js display. Define a single consolidation approach and identify what each scraper would consume from it. Done means these primitives are maintained and released from one shared place.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
tooling
Issue type
Refactor
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.