oxc-project / oxc-project/backlog

Track compile times

Open
#6 6 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
No language data
Stars
7
Forks
0
PR merge metrics
No merged PRs in 30d

Description

Problem

Compile times are something we care about, but we're not measuring them systematically, so we have little visibility over them.

Potential solution

Building the benchmarks is a fairly good analogue for real-world usage where you have a warm compiler cache.

  • Run benchmark builds with --timings.
  • Parse the HTML report to get total compile time for each benchmark.
  • Either:
    1. Make a comment on a PR if they improve / regress. or
    2. Upload them to CodSpeed (see last para of #5).
  • Bonus points: Display the graph from the timings report in a comment on any PR for which compile times get significantly better/worse.
  • Loads of bonus points: Convert the graph from timings report into an .out file so the graph appears as a faux flamegraph on CodSpeed. That'd give you a before/after diff too. (This is probably way too much work, and not worthwhile).

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by examining how benchmark builds are run and how the --timings HTML report is produced. Review the CodSpeed option referenced in #5, then define whether the first milestone is PR comments or CodSpeed uploads; done means benchmark compile times are collected and reported for regressions or improvements.

Written by the indexing model from the issue text.

Assessment

Domain
performance
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.