Automattic / Automattic/kue

Loss of progress events

Open
#1,146 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
9.4k
Forks
858
PR merge metrics
No merged PRs in 30d

Description

- my queue has 3 workers
- each worker processes a task that can last few minutes (e.g. 1-3 minutes)
- each worker, while processing a task, sends a progress

- about every 2/3 seconds
- the payload of each progress event is few MB (~1.5MB)

The client that receives the progress does not receive all the events.

Somewhere the progress events are lost.

Any recommendation to better investigate?

Contributor guide

No contributing guide indexed for this repository

Research direction

No files, tests, or entry points are named. Reproduce the setup with three workers, multi-minute tasks, progress events every 2–3 seconds, and payloads of about 1.5 MB, then trace delivery from worker emission to the receiving client. Done means identifying where events are lost and documenting or fixing the behavior with a regression test.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, node.js
Domain
backend, distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.