awslabs / awslabs/amazon-kinesis-client-python

Request for amazon-kclpy update to bundle amazon-kinesis-client 3.4.3

Open
#346 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
377
Forks
228
PR merge metrics
No merged PRs in 30d

Description

Could amazon-kclpy be updated to bundle amazon-kinesis-client 3.4.3? Is this update already in progress?

amazon-kclpy is currently at version 3.1.3, bundling amazon-kinesis-client 3.1.3 (September 2025). The Java KCL library is now at version 3.4.3 (April 2026), which includes several significant bug fixes that are not accessible to Python/MultiLangDaemon users until amazon-kclpy is updated.
Of particular interest is:
- #1734 Fix metricsScope not being closed properly in Scheduler.run (3.4.3)
- #1650 Remove explicit netty dependency to fix mismatched versions (3.2.1)

**Environment:**
- amazon-kclpy: 3.1.3 (latest available via pip)
- Java: 21 (OpenJDK)
- Python: 3.12
- Deployment: Docker container, AWS EC2

**Context:**
Over several days of monitoring I have observed slow but persistent RssAnon growth in the Java MultiLangDaemon processes. The growth is continuous and independent of record processing volume — streams processing zero records grow at the same rate as active streams — which points to the KCL infrastructure layer rather than application code. The fix in #1734 (metricsScope not being closed properly) is consistent with this pattern and may well be the cause.

Relevant properties file settings:
```
metricsLevel=SUMMARY
maxRecords=200
idleTimeBetweenReadsInMillis=200
shardSyncIntervalMillis=60000
failoverTimeMillis=10000
```

I am happy to provide detailed monitoring data if useful, but I think that an updated version of amazon-kclpy would be the preliminary step in debugging this issue.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.