'hoodie.datasource.read.incr.filters' is not used in the filegroup reader path
Open
area:incr-processing
engine:spark
from-jira
priority:medium
type:improvement
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
It is also not used in any tests so not sure if anyone is actually using this config
this should be done in the hadoopfsrelation factory if possible
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-9677
- Type: Improvement
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by tracing the filegroup reader path and the hadoopfsrelation factory mentioned in the issue, then search for hoodie.datasource.read.incr.filters and its existing tests. Confirm where the configuration should be applied and add coverage showing the filter is honored in this path.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100