MapColonies / MapColonies/naephi

removeOnComplete and removeOnFail job cleanup doesn't work on BatchWorker

Open
#22 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
TypeScript
Stars
0
Forks
0
PR merge metrics
No merged PRs in 30d

Description

**Describe the bug**
The `removeOnComplete` and `removeOnFail` job cleanups do not seem to work on the `BatchWorker` queues - `changeset-closure`, `changeset-osm-cleanup`, and `changeset-redis-cleanup` since those job processing are being interrupted to work in batches.

This means jobs are not being cleared from `BullMQ` on these queues.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing BatchWorker processing for the changeset-closure, changeset-osm-cleanup, and changeset-redis-cleanup queues, then inspect how BullMQ applies removeOnComplete and removeOnFail when batch work is interrupted. Done means completed and failed jobs on these queues are cleared according to those settings without breaking batch processing.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
backend
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.