spcl / spcl/serverless-benchmarks

Simplified build of 220.video-processing

Open
#316 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement good first issue reproducibility
Dominant language
Python
Stars
199
Forks
105
PR merge metrics
No merged PRs in 30d

Description

This benchmark relies on a static build of ffmpeg, which we source from an external website. Instead of pulling the ffmpeg binary at every single build, which adds a lot of pressure on that website in CI builds and can lead to errors when pulling data (e.g., rate limits), we could put a pinned and reproducible variant of ffmpeg in our benchmarks-data instead.

We should a new resources category in benchmarks-data, and change init.sh script to copy that binary during the initial build.

EDIT: we should also revise the command in the function to make sure that we explicitly select codecs and are reproducible.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by inspecting init.sh and the existing ffmpeg download path, then locate the benchmark function whose command needs explicit codec selection. Add the pinned binary under the new benchmarks-data resources category, update the initial build to copy it, and verify that repeated builds avoid external downloads and use reproducible codecs.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, shell
Domain
build-system, performance
Issue type
Refactor
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
58/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.