Follow up/ fix missing records from bloom filter partition in MDT
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
As of now, if a bloom filter for a file is missing from bloom filter partition in MDT, we ignore it.
HoodieMetadataTableUtil
{code:java}
// If reading the bloom filter failed then do not add a record for this file
if (bloomFilterBuffer == null) {
LOG.error("Failed to read bloom filter from " + addedFilePath);
return Stream.empty().iterator();
}
} {code}
we should think about on what scenario, this is possible and how exactly we can handle such situations.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-6684
- Type: Improvement
- Fix version(s):
- 1.1.0
---
## Comments
11/Aug/23 04:59;codope;Let's think about when this could happen, but if it is missing then why not simply add it?;;;
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.