dfinity / dfinity/canbench

Enhancement: Only show benchmarks with significant changes in PRs

Open
#31 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Rust
Stars
21
Forks
6
PR merge metrics
No merged PRs in 30d

Description

In a canbench PR comment like this one, we have many benchmarks, and it can be hard to spot which of the benchmarks exactly have been impacted. It'd be more readable if the CI comment only shows the specific benchmarks that have changed.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by examining the canbench pull-request comment shown in the linked example and trace how benchmark results are selected for that CI comment. Define significant changes from the existing benchmark output, then verify that unchanged benchmarks are omitted while impacted benchmarks remain visible.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
ci-cd, performance
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.