awslabs / awslabs/analytics-accelerator-s3
Analytics Accelerator Stream Hanging
- Dominant language
- Java
- Stars
- 72
- Forks
- 17
- PR merge metrics
- No merged PRs in 30d
Description
### Analytics Accelerator Library for Amazon S3 Version
1.0.0
### AWS Region
All Regions
### Describe the running environment
When Running with Iceberg 1.9.0 or Hadoop with the AAL enabled and you are running with the AWS CRT Client and you are using an AWS Java sdk version less than 2.31.30.
### What happened?
Threads can take longer than expected to run, and you see an error log that looks like:
"Error while getting data"
This is because the fix for this is not merged into Iceberg/Hadoop yet.
This is the relevant pr for the fix: https://github.com/aws/aws-sdk-java-v2/pull/5977/files
and this is the issue blocking the OSS community from upgrading their SDK version:
https://github.com/apache/hadoop/pull/7494#issuecomment-2718762118
We will work with the community to upgrade the SDK version once the blocking 3rd Party issue is resolved
### Code of Conduct
- [x] I agree to follow this project's Code of Conduct
Contributor guide
Research direction
Start by reproducing the reported environment: Iceberg 1.9.0 or Hadoop with the Analytics Accelerator enabled, the AWS CRT Client, and an AWS Java SDK version below 2.31.30. Review AWS SDK PR 5977 and the linked Hadoop PR discussion to determine when the blocking third-party issue is resolved. Done means the SDK dependency can be upgraded and the stream no longer hangs or logs "Error while getting data".
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, java
- Domain
- backend, cloud
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100