apache / apache/openwhisk

memory-based limit on concurrent invocations

Open
#4,196 2 comments 0 reactions 0 assignees View on GitHub
controller loadbalancer
Dominant language
Scala
Stars
6.8k
Forks
1.2k
Avg merge
2d 14h
Merged PRs (30d)
2

Description

Because of the switch to memory-based allocation of invoker slots, we also need the ability to limit users based on the amount of memory concurrently used by their running actions. A user that wants to run 200 concurrent 128MB actions is significantly (16x) easier for an OpenWhisk deployment to satisfy than a user that wants to run 200 concurrent 2GB actions.

The implementation would parallel the current invocation-based counting of concurrent actions (but would increment/decrement by the action's requested memory instead of counting all actions equally as 1).

We should probably implement a separate memory-based concurrency limit initially, then consider whether we actually need both count-based and memory-based concurrency limits and perhaps deprecate the count-based limit.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.