AlexsLemonade / AlexsLemonade/refinebio

Janitor jobs need to be dispatched to all job queues

Open
#2,789 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
135
Forks
21
PR merge metrics
No merged PRs in 30d

Description

### Context

https://github.com/AlexsLemonade/refinebio/blob/db4557b48aa9f2ecbb544d722b4b1403d9a990e3/foreman/data_refinery_foreman/foreman/job_control.py#L48

We're only sending one janitor job at the moment, even though we have more than one job queue.

### Problem or idea

We need to send one janitor job for each job queue in `ALL_BATCH_JOB_QUEUES`.

### Solution or next step

Right now `send_job` doesn't accept a job_queue parameter, but I think it should so that the job_control can create one per job queue.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start in foreman/data_refinery_foreman/foreman/job_control.py at the janitor dispatch near ALL_BATCH_JOB_QUEUES, then inspect send_job and how it is called. Done means janitor work is dispatched once for every queue in ALL_BATCH_JOB_QUEUES, with each dispatch receiving its queue.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
backend, distributed-systems
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.