awslabs / awslabs/amazon-kinesis-client-python

Follow up question: how to use initialize_input parameter

Open
#86 1 comment 0 reactions 0 assignees View on GitHub
question
Dominant language
Python
Stars
377
Forks
228
PR merge metrics
No merged PRs in 30d

Description

@pfifer Thanks for your reply in this issue https://github.com/awslabs/amazon-kinesis-client-python/issues/81 . The document of AWS kinesis said that 'The KCL calls the initialize method when the record processor is instantiated, passing a specific shard ID as a parameter. This record processor processes only this shard' (https://docs.aws.amazon.com/streams/latest/dev/kinesis-record-processor-implementation-app-py.html). So if I develop my application in python, how can I scale it when there are large volume of data ?

Contributor guide

Open the contributing guide

Research direction

The issue names no repository file, test, or entry point. Read the linked issue 81 and the AWS Kinesis record-processor documentation first, then determine what scaling guidance is missing; done would be a clear, project-appropriate answer or documentation update explaining how a Python application handles larger data volumes.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python
Domain
cloud
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.