kernelci / kernelci/kernelci-core

Scale lab queue limits based on number of devices

Open
#3,039 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
120
Forks
107
Avg merge
1d 2h
Merged PRs (30d)
21

Description

Since the introduction of support for limiting the number of jobs in https://github.com/kernelci/kernelci-core/commit/aeb2684203484f69447aacf903f5b7f09b19c138 we queue on labs we've used an absolute limit on the number of jobs that's specified as a simple number of jobs. At the minute that's 50. This limit is applied no matter how many devices that a lab has available, so for example with my lab where I have 5 BeagleBone Blacks available with average job runtimes of approximately 5 minutes we'd clear 50 jobs in about an hour which is reasonably responsive. In contrast if I only had one board the same jobs would take over 4 hours which is much less usable.

A simple improvement would be to scale the limit based on the number of devices of a given type that a lab has, picking a smaller limit per board but allowing us to make use of larger lab capacities.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with commit aeb2684203484f69447aacf903f5b7f09b19c138 and trace where the current absolute lab queue limit is applied. Review how device types and available lab capacity are represented, then define the scaled limit and verify that labs with different numbers of devices receive appropriate queue limits.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.