developmentseed / developmentseed/stactools-pipelines

Add max SQS concurrency settings to app.py Lambda to avoid Cognito or Dynamo throttling.

Open
#50 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
9
Forks
4
PR merge metrics
No merged PRs in 30d

Description

Currently the app.py Lambda will scale linearly with the number of messages in the queue. To avoid quota limits with Cognito token retrieval and posting of items to Dynamo (less likely) we should institute some sensible event source concurrency limits https://aws.amazon.com/blogs/compute/introducing-maximum-concurrency-of-aws-lambda-functions-when-using-amazon-sqs-as-an-event-source/.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.