bazelbuild / bazelbuild/continuous-integration

Implement sensible timeout for long-running tasks

Open
#1,238 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
302
Forks
194
Avg merge
1d 19h
Merged PRs (30d)
41

Description

I had to cancel https://buildkite.com/bazel/bazel-at-head-plus-downstream/builds/2193 after 13 hours (!). The culprit was [rules_nodejs (rbe_ubuntu1604)](https://buildkite.com/bazel/bazel-at-head-plus-downstream/builds/2193#73a307c3-5c1e-43c0-a737-c2a0cd6ed940): The first task timed out after 8 hours, the second one had been running for 5.5 hours when I cancelled it.

Contributor guide

Open the contributing guide

Research direction

Start with the linked Buildkite build and the rules_nodejs (rbe_ubuntu1604) task that ran for hours. Trace the continuous-integration configuration responsible for task timeouts and determine where a sensible limit should apply. Done means long-running tasks stop within the agreed timeout and the affected CI behavior is verified.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ci-cd, devops
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.