aws / aws/apprunner-roadmap

Error 429 Too Many Requests when App Runner is scaling out

Open
#224 0 comments 35 reactions 0 assignees View on GitHub
Dominant language
No language data
Stars
301
Forks
15
PR merge metrics
No merged PRs in 30d

Description

**Community Note**
* Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
* Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do * not help prioritize the request
If you are interested in working on this issue or have submitted a pull request, please leave a comment

---

## Tell us about your request
App Runner's documentation should be more transparent and warn users about the potential traffic drops due to error 429 Too Many Requests when App Runner is scaling out so that users can adjust the max concurrency value and other configurations accordingly.

## Describe alternatives you've considered
I suppose App Runner can always be better and faster at scaling out, and the max concurrency value can be higher.

## Additional context
We eventually mitigated this by:
- Setting a longer request timeout for the platform that is sending requests to the App Runner instances.
- Setting the max concurrency value to the maximum (200) in auto scaling settings.
- Increasing the minimal size in auto scaling settings (while lowering the vCPU & memory in service settings).

Please see the attachments for more information.

## Attachments
Metrics from our App Runner:
![app-runner-scaling-up-error-1](https://github.com/aws/apprunner-roadmap/assets/31707422/c224b010-1646-4a6f-bbce-89f61a46eed8)
![app-runner-scaling-up-error-2](https://github.com/aws/apprunner-roadmap/assets/31707422/248db97d-ac5d-42a9-aaa5-b5667ff2306c)

[Information shared by someone from AWS](https://www.reddit.com/r/aws/comments/174vwzq/comment/k4bufy5/?utm_source=share&utm_medium=web2x&context=3):
![Screenshot 2023-12-07 195927](https://github.com/aws/apprunner-roadmap/assets/31707422/0dddfa27-3501-4e3c-9d04-ae2b5dcd1ae0)
![Slide42](https://github.com/aws/apprunner-roadmap/assets/31707422/bdd30012-dffd-4805-b8ec-eecc7f775843)
![Slide43](https://github.com/aws/apprunner-roadmap/assets/31707422/a231356c-7652-42ed-99b9-eb01ff0d9f31)

Contributor guide

Open the contributing guide

Research direction

Review the App Runner documentation covering scaling out, auto scaling settings, max concurrency, request timeout, and HTTP 429 responses. Confirm how current guidance describes traffic drops during scale-out; done means clearly documenting the risk and the relevant configuration mitigations, then verifying the warning is understandable.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws
Domain
cloud
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.