apache / apache/hudi

Enhance TestColumnStatsIndex to test indexing with regular writes and table services

Open
#15,136 1 comment 0 reactions 0 assignees View on GitHub
area:metadata-table area:table-service area:tests component:clustering component:compaction from-jira priority:critical type:devtask
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Beef up {{TestColumnStatsIndex}} running through all Hudi flows (insert, upsert, deletion, rollback, compaction, clustering, etc) for both COW/MOR.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-3914
- Type: Task
- Epic: https://issues.apache.org/jira/browse/HUDI-1822

Contributor guide

No contributing guide indexed for this repository

Research direction

Locate TestColumnStatsIndex and read its existing coverage and test setup first. Extend the test coverage across insert, upsert, deletion, rollback, compaction, and clustering flows for both COW and MOR, including table services, then run the relevant test class to verify each flow.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, testing
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.