awslabs / awslabs/amazon-kinesis-client-python
Persist State Across App Shutdowns/Credentials Store
- Dominant language
- Python
- Stars
- 377
- Forks
- 228
- PR merge metrics
- No merged PRs in 30d
Description
2 Questions:
1) How can I persist the last processed sequence id, should I just store and initialize a KCL with that sequence id, as part of the initialize and shutdown methods? I am looking to be able to shutdown the KCL app and then restart it and it pick up where it left off. I know while the app is running it persists in DynamoDb but would be great to also persist across shutdowns?
2) Is it possible to programatically get the credentials. We use a special secret vault, I would love a way to pass credentials in during the initialize or startup method versus having to hard code them into the environment. Another option I thought about is to wrap the KCL library and programatically add them to the environment before calling kcl.KCLProcess()
Contributor guide
Assessment
This issue has not been assessed yet.