apache / apache/hudi

Add validation of new index types in HoodieMetadataTableValidator

Open
#17,269 1 comment 0 reactions 1 assignee Assigned to @nsivabalan View on GitHub
from-jira priority:critical type:devtask
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Hudi 1.0 / master adds new indexes supported in MDT, including functional index, secondary index, and partition stats index. We should also make the validator generalized so it can be extend to support new index validation easily in the future. Along with this, fix any issues in HoodieMetadataTableValidator around timeline fetch, filtering, etc.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-8177
- Type: Sub-task
- Parent: https://issues.apache.org/jira/browse/HUDI-8714
- Fix version(s):
- 1.1.0

---

## Comments

09/Oct/24 01:51;yihua;Upsert validation of secondary index and validation of functional index still need to be finished.;;;

---

30/Oct/24 01:44;yihua;The only remaining work is adding functional index validation in the MDT validation (to be fixed by HUDI-8263).;;;

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.