aws-samples / aws-samples/amazon-managed-service-for-apache-flink-examples
Errors when trying S3TablesSink with Iceberg v 1.9.1
- Dominant language
- Java
- Stars
- 91
- Forks
- 47
- PR merge metrics
- No merged PRs in 30d
Description
I've used this example as a base for my work: https://github.com/aws-samples/amazon-managed-service-for-apache-flink-examples/blob/main/java/Iceberg/S3TableSink/pom.xml#L22
It uses Iceberg version 1.6.1 and works fine, but when I've tried a more recent version 1.9.1, it starts throwing errors like:
- `java.lang.ClassNotFoundException: org.apache.iceberg.types.Types$UnknownType`
- `java.lang.NoSuchMethodError: 'org.apache.iceberg.types.Type org.apache.iceberg.types.Types.fromTypeName(java.lang.String)'`
Could you please update this example to the latest Iceberg version.
Also the current pom file uses some ambiguous dependencies, like it has two identical `iceberg-flink` dependencies (lines 140 and 145) and in addition `iceberg-flink-1.19` under Logging section (line 186).
Contributor guide
Research direction
Start with the S3TableSink pom.xml linked in the issue and compare its Iceberg 1.6.1 dependencies with version 1.9.1. Run the S3TableSink example to reproduce the reported class and method errors, then verify that the dependency declarations are unambiguous and the example works with the selected Iceberg version.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, java
- Domain
- build-system, stream-processing
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100