JobManager crashed when insert into hudi table with flink clean option
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
I am using Flink 1.17.1, Hudi 0.15.0, hadoop-3.3.4, I run flink in standalone mode
When I run the following sql, the job process crashed and exit, the exception is
```
[ERROR] Could not execute SQL statement. Reason:
org.apache.flink.runtime.rest.util.RestClientException: [Internal server error.,
Contributor guide
No contributing guide indexed for this repository
Research direction
No source files or tests are named. Reproduce the Flink standalone job with the Hudi table definition and clean options, then compare it with the working definition without those options; inspect the complete JobManager termination logs beyond the reported RPC exception. Done means identifying the clean-related failure and documenting or testing a fix that prevents the job from crashing.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, sql
- Domain
- data-engineering, databases, stream-processing
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100