AlexsLemonade / AlexsLemonade/refinebio
Janitor jobs need to be dispatched to all job queues
- Dominant language
- Python
- Stars
- 135
- Forks
- 21
- PR merge metrics
- No merged PRs in 30d
Description
### Context
https://github.com/AlexsLemonade/refinebio/blob/db4557b48aa9f2ecbb544d722b4b1403d9a990e3/foreman/data_refinery_foreman/foreman/job_control.py#L48
We're only sending one janitor job at the moment, even though we have more than one job queue.
### Problem or idea
We need to send one janitor job for each job queue in `ALL_BATCH_JOB_QUEUES`.
### Solution or next step
Right now `send_job` doesn't accept a job_queue parameter, but I think it should so that the job_control can create one per job queue.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start in foreman/data_refinery_foreman/foreman/job_control.py at the janitor dispatch near ALL_BATCH_JOB_QUEUES, then inspect send_job and how it is called. Done means janitor work is dispatched once for every queue in ALL_BATCH_JOB_QUEUES, with each dispatch receiving its queue.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- backend, distributed-systems
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Clearly specified
- Newbie friendliness
- 45/100