apache / apache/hudi

[SUPPORT] Remove flink state invalid calls

Open
#8,951 6 comments 0 reactions 0 assignees View on GitHub
engine:flink
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

**Describe the problem you faced**
When using the flink state index and not isChangingRecords, access state is invalid.
The call of state should be after judging isChangingRecords.

https://github.com/apache/hudi/blob/e9a67bfc49759637ec680c27179e25c01cae10b7/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/partitioner/BucketAssignFunction.java#L178

iIf you agree this, please let me submit pr

**Environment Description**

* Hudi version : 0.13.1

Contributor guide

No contributing guide indexed for this repository

Research direction

Start at hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/partitioner/BucketAssignFunction.java around line 178 and inspect how state is accessed relative to isChangingRecords. Verify the state call is valid for the non-changing-record path, then run the relevant Flink tests; the issue is done when invalid state access no longer occurs.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
stream-processing
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.