aws-samples / aws-samples/amazon-managed-service-for-apache-flink-examples

Errors when trying S3TablesSink with Iceberg v 1.9.1

Open
#140 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
91
Forks
47
PR merge metrics
No merged PRs in 30d

Description

I've used this example as a base for my work: https://github.com/aws-samples/amazon-managed-service-for-apache-flink-examples/blob/main/java/Iceberg/S3TableSink/pom.xml#L22
It uses Iceberg version 1.6.1 and works fine, but when I've tried a more recent version 1.9.1, it starts throwing errors like:

- `java.lang.ClassNotFoundException: org.apache.iceberg.types.Types$UnknownType`
- `java.lang.NoSuchMethodError: 'org.apache.iceberg.types.Type org.apache.iceberg.types.Types.fromTypeName(java.lang.String)'`

Could you please update this example to the latest Iceberg version.
Also the current pom file uses some ambiguous dependencies, like it has two identical `iceberg-flink` dependencies (lines 140 and 145) and in addition `iceberg-flink-1.19` under Logging section (line 186).

Contributor guide

Open the contributing guide

Research direction

Start with the S3TableSink pom.xml linked in the issue and compare its Iceberg 1.6.1 dependencies with version 1.9.1. Run the S3TableSink example to reproduce the reported class and method errors, then verify that the dependency declarations are unambiguous and the example works with the selected Iceberg version.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, java
Domain
build-system, stream-processing
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.