[SUPPORT] Flink streaming write to Hudi table using data stream API java.lang.NoClassDefFoundError: org.apache.hudi.configuration.FlinkOptions
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
I have a simple FLINK streaming code that reads the data from Kafka and write it into a Hudi table. I have followed the exact same code shown in this link - https://hudi.apache.org/docs/flink-quick-start-guide/#quick-start.
It is running fine in my local machine but not running within cluster where there are 2 task managers and 1 job manager.
The Flink cluster is running inside AKS. I have added all dependencies to the lib folder of the flink container but still the following exception persits.
When submitting the jar File I am getting the following error
`
org.apache.flink.runtime.rest.handler.RestHandlerException: Could not execute application. at org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequest$1(JarRunHandler.java:113) at java.base/java.util.concurrent.CompletableFuture.uniHandle(Unknown Source) at java.base/java.util.concurrent.CompletableFuture$UniHandle.tryFire(Unknown Source) at java.base/java.util.concurrent.CompletableFuture.postComplete(Unknown Source) at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.CompletionException: java.lang.NoClassDefFoundError: Could not initialize class org.apache.hudi.configuration.FlinkOptions at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(Unknown Source) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(Unknown Source) ... 2 more `
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.