apache / apache/hudi

Implement methods in HFileUtils extends BaseFileUtils

Open
#16,482 1 comment 0 reactions 0 assignees View on GitHub
area:core from-jira priority:high type:improvement
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

org.apache.hudi.common.util.HFileUtils only has 2 methods implemented and the rest throw unsupported operation exceptions. Implement the other methods so that we can use hfile the same as we use orc and parquet for base files.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-7741
- Type: Improvement
- Epic: https://issues.apache.org/jira/browse/HUDI-6243

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with org.apache.hudi.common.util.HFileUtils and its BaseFileUtils interface, then compare the corresponding ORC and Parquet utilities. Implement the currently unsupported HFile methods so HFile can be used like the other base-file formats, and verify that no required methods still throw unsupported-operation exceptions.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.