Verify if Hudi iterators have been closed properly
Open
from-jira
priority:high
type:bug
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
Hudi has iterators, like FG reader iterator. We need to make sure they are properly closed after usage. Otherwise, memory leak could happen.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-9209
- Type: Bug
- Affects version(s):
- 1.1.0
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by tracing the FG reader iterator and other Hudi iterator usages mentioned in the issue, then inspect their lifecycle through the surrounding code. The work is complete when iterator closure after usage has been verified across the affected paths and the memory-leak concern is addressed.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 38/100