Add validation of new index types in HoodieMetadataTableValidator
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
Hudi 1.0 / master adds new indexes supported in MDT, including functional index, secondary index, and partition stats index. We should also make the validator generalized so it can be extend to support new index validation easily in the future. Along with this, fix any issues in HoodieMetadataTableValidator around timeline fetch, filtering, etc.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-8177
- Type: Sub-task
- Parent: https://issues.apache.org/jira/browse/HUDI-8714
- Fix version(s):
- 1.1.0
---
## Comments
09/Oct/24 01:51;yihua;Upsert validation of secondary index and validation of functional index still need to be finished.;;;
---
30/Oct/24 01:44;yihua;The only remaining work is adding functional index validation in the MDT validation (to be fixed by HUDI-8263).;;;
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.