Automattic / Automattic/kue

duplicate queue events when there are multiple queue events listener

Open
#1,152 0 comments 2 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
9.4k
Forks
858
PR merge metrics
No merged PRs in 30d

Description

I disabled the job events and did the job cleanup in the queue events.
When there are same queue events listeners running in multiple processes, every process will try to do the job cleanup. For one process, it runs successfully. For other it fails.
job cleanup is just an example. If I do other cleanup tasks in queue events listener. those are duplicated.
Is there any solution/workaround to this problem?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the behavior with identical queue event listeners running in multiple processes, focusing on the queue events listener and job cleanup described in the issue. Determine whether cleanup can be coordinated so it runs only once, and verify that other cleanup tasks triggered by queue events are not duplicated.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, node.js, redis
Domain
backend, distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.