apache / apache/hudi

Troubleshoot `testMetadataColumnStatsIndexPartialProjection` flakiness

Open
#15,617 1 comment 0 reactions 0 assignees View on GitHub
from-jira priority:medium status:pr-available type:bug
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Test is periodically failing in CI, trying it repro locally was able to make it fail only once (w/ valueCount flip-flopping b/w 3 and 4 for a single file) out of a dozen runs.

Examples of failing runs:

[https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=13428&view=logs&j=3272dbb2-0925-5f35-bae7-04e75ae62175&t=fb428e45-27ff-524a-7e12-db1cb49c418a&s=ee3800fd-6e81-525f-e564-94108585217d]

 

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-5354
- Type: Bug
- Epic: https://issues.apache.org/jira/browse/HUDI-4302

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the test named testMetadataColumnStatsIndexPartialProjection and compare its local behavior with the linked Azure CI failure logs. Reproduce the failure across repeated runs, focusing on the reported valueCount change from 3 to 4 for one file. Done means the flakiness is explained and the test or underlying behavior is made reliable.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.