awslabs / awslabs/analytics-accelerator-s3

Analytics Accelerator Stream Hanging

Open
#263 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Java
Stars
72
Forks
17
PR merge metrics
No merged PRs in 30d

Description

### Analytics Accelerator Library for Amazon S3 Version

1.0.0

### AWS Region

All Regions

### Describe the running environment

When Running with Iceberg 1.9.0 or Hadoop with the AAL enabled and you are running with the AWS CRT Client and you are using an AWS Java sdk version less than 2.31.30.

### What happened?

Threads can take longer than expected to run, and you see an error log that looks like:
"Error while getting data"

This is because the fix for this is not merged into Iceberg/Hadoop yet.
This is the relevant pr for the fix: https://github.com/aws/aws-sdk-java-v2/pull/5977/files

and this is the issue blocking the OSS community from upgrading their SDK version:
https://github.com/apache/hadoop/pull/7494#issuecomment-2718762118

We will work with the community to upgrade the SDK version once the blocking 3rd Party issue is resolved

### Code of Conduct

- [x] I agree to follow this project's Code of Conduct

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the reported environment: Iceberg 1.9.0 or Hadoop with the Analytics Accelerator enabled, the AWS CRT Client, and an AWS Java SDK version below 2.31.30. Review AWS SDK PR 5977 and the linked Hadoop PR discussion to determine when the blocking third-party issue is resolved. Done means the SDK dependency can be upgraded and the stream no longer hangs or logs "Error while getting data".

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, java
Domain
backend, cloud
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.