adoptium / adoptium/infrastructure

Clean up unused directories under `jobs` on the jenkins server

Open
#2,998 0 comments 0 reactions 0 assignees View on GitHub
critical Jenkins reliability
Dominant language
Python
Stars
96
Forks
106
Avg merge
1d 23h
Merged PRs (30d)
13

Description

Extracted from https://github.com/adoptium/infrastructure/issues/2108#issuecomment-1469958569

We have a lot of jobs not in the UI but are on the file system. This seems to be because the config.xml has gone but the job directory is still present (Maybe due to artefacts being kept after job deletion?). These can be identified with `for A in *; do if [ ! -r $A/config.xml ]; then ls -ld $A; fi; done` in the `jobs` directory - at the time of writing there are 1695 without a config.xml (directly under jobs) of which all but 195 are Test_openjdk ones.

897 of these are @script directories as opposed to job directories that mostly contain extracted copies of openjdk-tests (Now an obsolete name). Of the 2736 @script ones, 689 have a corresponding job named the same, so over 200 do not. Only one of those 689 (Grinder_perf) is missing a config.xml.

There are also 15 `@tmp` suffixed directories and six `@libs`

None of the analysis above covers anythign that might be in subfolders.

I suspect we should clean up all of the `@script` directories (The most recently updated one was from 2021) and also have a backup/purge on all other directories without a config.xml

Contributor guide

Open the contributing guide

Research direction

Start with the extracted discussion in infrastructure issue 2108 and inspect the Jenkins jobs directory using the provided config.xml check. Review the @script, @tmp, @libs, and other directories lacking config.xml, including possible subfolders. Done means agreeing on backup and purge scope and cleaning the obsolete directories without removing active jobs.

Written by the indexing model from the issue text.

Assessment

Tech stack
bash
Domain
devops, infrastructure
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.