apache / apache/hudi

HFileWriter, HFileReader and HFileDataBlock should avoid hardcoded key field name

Open
#15,008 0 comments 0 reactions 1 assignee Claimed by @yihua View on GitHub
area:code-quality area:metadata-table from-jira priority:high type:improvement
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Today HFileReader has the hardcoded key field name for the schema. This key field is used by HFileWriter, HFileDataBlock for HFile key dedupliacation feature. When users want to use the HFile format, this hard coded key field name can be preventing the usecase. We need a way to pass in the writer/reader/query configs to the HFile storage layer so as to use the right key field name. 

 

Related: HUDI-2763

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-3321
- Type: Improvement
- Epic: https://issues.apache.org/jira/browse/HUDI-6243
- Fix version(s):
- 1.1.0

---

## Comments

30/Mar/22 06:15;xushiyan;Discussed with [~shivnarayan] we need this when we want to support hfile as base file. cc [~guoyihua]
;;;

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.