spcl / spcl/serverless-benchmarks

Polyglot SeBS

Open
#235 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

aws azure gcp good first issue
Dominant language
Python
Stars
199
Forks
105
PR merge metrics
No merged PRs in 30d

Description

In SeBS, we initially focused on Python and Node.js; not all benchmarks have a Node.js implementation. We have pending support for C++ (#145) and Java (#223). However, we want to have at least microbenchmarks in many other languages:

  • Merge Java support (#223)
  • Missing Node.js benchmarks
  • Add Node.js CRUD benchmark with NoSQL storage.
  • Missing C++ benchmarks (image processing, image recognition) + #94
  • .NET
  • Rust
  • Go
  • New runtimes for Java, e.g., GraalVM
  • New runtimes for Node.js, like Bun and LLRT
  • New runtimes for Python, like PyPy or CPython 3.13 with the experimental JIT flag (needs manual build)

We should be able to benchmark the impact of choosing alternative runtimes.

How to support new and custom runtimes?

  • AWS -> supported by default.
  • Azure - we can implement custom handlers via HTTP
  • GCP - Google Cloud Functions 2nd gen are built on Cloud Run, so we could run custom images (only Docker) on Cloud Run and then create triggers ourselves.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files or tests are named; start by reviewing the runtime checklist and the linked issues #145, #223, and #94, along with the AWS, Azure, and GCP notes. Done would require a selected runtime or platform support scope, implemented benchmark coverage, and a way to compare alternative runtimes.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, azure, bun, cpp, docker, gcp, go, java, node.js, python, rust
Domain
backend, cloud, performance, testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.