apache / apache/hudi

Support Partition stats, column stats, bloom filters creation using SQL

Open
#17,352 1 comment 0 reactions 1 assignee Assigned to @nsivabalan View on GitHub
area:index from-jira priority:high type:devtask
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Users cannot create partition_stats, column_statas and bloom_filters indexes through SQL. They can only be created through datasource. There are workarounds e.g. one can create expression index using column_stats with identity function of a column. But, we should provide more standard sql for building these indexes.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-8812
- Type: Sub-task
- Parent: https://issues.apache.org/jira/browse/HUDI-9101
- Fix version(s):
- 1.1.0

---

## Comments

13/Mar/25 14:12;codope;Currently, columns being indexed in colstats (and by extension partition_stats too) are being tracked in index definition. So, when user adds a column stats are being colelcted automatically, so adding sql functionality is not a blocker. Downgrading from Blocker to Major. Still, would be nice-to-have a sql command to generate stats.;;;

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.