Automattic / Automattic/kue

RAM grows exponentially with Redis 4 - Redis 3 all work fine

Open
#1,159 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
9.4k
Forks
858
PR merge metrics
No merged PRs in 30d

Description

When I use Kue with Redis 4 (current stable version) RAM grows exponentially in few time. For example, it achieves 62GB in about 1 minute.

In my case this issue is occurring with 100 workers, that sends MBs of data to a client using job.progress() (e.g. 500MB/s).

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the report with Redis 4, 100 workers, and jobs sending high-volume data through job.progress(); compare the result with Redis 3. Trace the memory growth during progress updates and determine whether the issue is in Kue or Redis, with completion shown by stable memory usage under the reported workload.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, node.js, redis
Domain
backend, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.