Automattic / Automattic/kue

Changing concurrency dynamically

Open
#447 15 comments 0 reactions 0 assignees View on GitHub
Discussion Feature
Dominant language
JavaScript
Stars
9.4k
Forks
858
PR merge metrics
No merged PRs in 30d

Description

As I understand there is no easy way now to change concurrency on the fly.

Starting more processor could work to increase concurrency:

``` js
jobs.process('email', 10, function processEmail(job, done){...});
// later, add 5 to concurrency
jobs.process('email', 5, processEmail);
```

Looks hacky, and how do I lower concurrency?

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names jobs.process as the entry point; start by tracing how its concurrency argument is applied to a running worker. Clarify the expected behavior for increasing and decreasing concurrency, then define tests for both directions; done means concurrency can be changed dynamically without restarting the worker.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, node.js
Domain
backend, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.