rust-lang / rust-lang/rustc-perf

Show changes over time to compiler performance in the triage report

Open
#1,044 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

A-triage C-feature-request
Dominant language
Rust
Stars
733
Forks
189
Avg merge
10h 52m
Merged PRs (30d)
43

Description

The triage report has improved, but its focus is largely on highlighting single changes impacts on the performance of the Rust compiler. We should think more holistically about what we want to get from the triage report.

Specfically we should add more detail about change over time. For instance, we can show change over the last 1 week/over the period in the triage report, 1 month, 6 months, 1 year, etc.

To do this we can:

  • Link to comparison pages that show this difference
  • Summarize the difference by showing average percent changes per profile and per scenario (over all benchmarks). Finding the right data to expose here will be a challenge.
  • Furthermore, we can highlight changes specifically in real-world benchmarks as this might provide clearer insight over stress tests (which are generally there to prevent regressions)

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the triage report and its existing single-change performance views, then inspect the comparison pages and the data available for profiles, scenarios, and benchmarks. Done means the report exposes meaningful change over periods such as a week, month, six months, and a year, including useful summaries or links and clearer insight from real-world benchmarks.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
compilers, data-visualization, performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.