apache / apache/hudi

Reach the ASF SHOULD target of at most 15 concurrent CI runners

Open Beginner friendly
#19,527 1 comment 0 reactions 0 assignees View on GitHub
area:ci priority:high
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

After the trim in #19514, a push peaks at around 16 concurrent runners. The [ASF policy](https://infra.apache.org/github-actions-policy.html) says concurrency SHOULD be at most 15.

`max-parallel` does not help: it caps matrix entries within a job, and every surviving job has exactly one entry, so peak concurrency equals the job count. Merging `test-flink-1` with `test-flink-2`, and the two bundle-validation jobs, gets there and is free in wall clock, since both merged jobs (69 min and 25 min measured) stay inside the critical path set by `test-spark-java17-java-tests-part1` at roughly 70 min.

Part of #19524.

Contributor guide

No contributing guide indexed for this repository

Research direction

Locate the GitHub Actions workflow containing test-flink-1, test-flink-2, and the two bundle-validation jobs; inspect how those jobs are defined and how their dependencies affect concurrency. Merge the specified job pairs, then verify that peak concurrency is at most 15 and the merged jobs remain within the existing critical path.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions
Domain
ci-cd
Issue type
Refactor
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Active
Clarity
Clearly specified
Newbie friendliness
76/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.