knowsys / knowsys/nemo

Implement meaningful Benchmarks that can be used as performance regression tests

Open
#311 0 comments 1 reaction 0 assignees View on GitHub
enhancement regression tests
Dominant language
Rust
Stars
289
Forks
21
PR merge metrics
No merged PRs in 30d

Description

We technically have benchmarks right now but those are not meaningful.
We should write benchmarks that reflect common use cases to be able to use them as regression tests before merging PRs.
It can still be decided if this should be integrated into CI.

Contributor guide

Open the contributing guide

Research direction

Start by locating and reviewing the existing benchmarks in the repository, then identify which common Nemo use cases they should represent. Define how benchmark results will serve as regression tests and whether they belong in CI; the work is done when meaningful benchmark coverage and an agreed execution approach are established.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
performance, testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.