aws / aws/containers-roadmap

[ECS] [request]: Increase "Tasks in PROVISIONING state per cluster" service quota

Open
#1,780 0 comments 0 reactions 0 assignees View on GitHub
ECS Proposed
Dominant language
Shell
Stars
5.4k
Forks
334
PR merge metrics
No merged PRs in 30d

Description

### Community Note

* Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the community and maintainers prioritize this request
* Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
* If you are interested in working on this issue or have submitted a pull request, please leave a comment

**Tell us about your request**
Currently, the 'Tasks in PROVISIONING state per cluster' limit is 300, as listed on https://docs.aws.amazon.com/AmazonECS/latest/userguide/service-quotas.html. (In 2020, this limit was 100, but it has since increased to 300. [source](https://aws.amazon.com/blogs/containers/deep-dive-on-amazon-ecs-cluster-auto-scaling/)) I'd like to see this limit increased to 1000+, or made configurable, so we can increase this service quota on an account by account basis.

**Which service(s) is this request for?**
ECS

**Tell us about the problem you're trying to solve. What are you trying to do, and why is it hard?**
We are using ECS to create an EC2-based compute fleet for massive machine learning jobs that require 500+ worker instances. As a result of this limit, we cannot scale up all of our workers at once (in our case, each ECS task corresponds to a single worker).

**Are you currently working around this issue?**
Yes, currently we have keep polling the number of active tasks, catch errors from exceeding the 'Tasks in PROVISIONING state per cluster' threshold, and retry.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the AWS ECS service-quotas documentation linked in the issue and the described 300-task PROVISIONING limit. Confirm how quota increases or account-level configuration are requested and whether the reported 500+ worker scaling case is supported. Done means AWS provides the requested higher or configurable quota, with the issue updated to reflect the outcome.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws
Domain
cloud, infrastructure
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.