[ECS] [request]: Increase "Tasks in PROVISIONING state per cluster" service quota
- Dominant language
- Shell
- Stars
- 5.4k
- Forks
- 334
- PR merge metrics
- No merged PRs in 30d
Description
### Community Note
* Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the community and maintainers prioritize this request
* Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
* If you are interested in working on this issue or have submitted a pull request, please leave a comment
**Tell us about your request**
Currently, the 'Tasks in PROVISIONING state per cluster' limit is 300, as listed on https://docs.aws.amazon.com/AmazonECS/latest/userguide/service-quotas.html. (In 2020, this limit was 100, but it has since increased to 300. [source](https://aws.amazon.com/blogs/containers/deep-dive-on-amazon-ecs-cluster-auto-scaling/)) I'd like to see this limit increased to 1000+, or made configurable, so we can increase this service quota on an account by account basis.
**Which service(s) is this request for?**
ECS
**Tell us about the problem you're trying to solve. What are you trying to do, and why is it hard?**
We are using ECS to create an EC2-based compute fleet for massive machine learning jobs that require 500+ worker instances. As a result of this limit, we cannot scale up all of our workers at once (in our case, each ECS task corresponds to a single worker).
**Are you currently working around this issue?**
Yes, currently we have keep polling the number of active tasks, catch errors from exceeding the 'Tasks in PROVISIONING state per cluster' threshold, and retry.
Contributor guide
Research direction
Start by reviewing the AWS ECS service-quotas documentation linked in the issue and the described 300-task PROVISIONING limit. Confirm how quota increases or account-level configuration are requested and whether the reported 500+ worker scaling case is supported. Done means AWS provides the requested higher or configurable quota, with the issue updated to reflect the outcome.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws
- Domain
- cloud, infrastructure
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 20/100