197g / 197g/rustc-pathogen

The reason behind inflated compilation times in `deep-and-broad`

Open
#1 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Shell
Stars
5
Forks
0
PR merge metrics
No merged PRs in 30d

Description

This is a guess:

Old incremental builds seem not to be cleanup when the dependencies change. That leads to a quadratic number of remnant folders of incremental states. Since the incremental engine iterates *all of* them when finding a suitable build folder to pick off (and finds none), this will do a quadratic number of io actions.

Reasoning:

After executing the creation script for a while we find a ton of remanining incremental directories

```bash
$ find -type d -name 'deeper*' target/incremental | wc -l
5402
```

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue describes a potential cause of inflated compilation times in the `deep-and-broad` scenario, likely related to incremental compilation in rustc/cargo. Start by examining the script that creates the scenario and the target/incremental directories it leaves behind. Investigate how cargo manages incremental build folders and when they are cleaned up. Look for the code in cargo or rustc that iterates over these directories. Determine if old incremental states are being retained when dependencies change, leading to quadratic IO.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
build-system
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.