apache / apache/hudi

Add support for secondary index for non-global indexes

Open
#16,706 1 comment 0 reactions 1 assignee Assigned to @nsivabalan View on GitHub
area:metadata-table from-jira priority:critical type:improvement
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

As of now, secondary index returns the primary keys for the secondary keys and we look up in RLI to fetch the file groups for the corresponding primary keys. But RLI is only supported for global indexes and so current support for secondary index is also the same. 

i.e one cannot use secondary index for non-global indexes. We might need to support this as its the most common type of index. 

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-8446
- Type: Improvement
- Fix version(s):
- 1.1.0

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.