apache / apache/hudi

Evaluate alternatives to using "hoodie.properties" as state store for Metadata Table

Open
#15,205 0 comments 0 reactions 1 assignee Assigned to @nsivabalan View on GitHub
area:metadata-table from-jira priority:critical type:bug
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Currently Metadata Table uses "hoodie.properties" file as a state-store adding properties reflecting the state of the metadata table being indexed.

This is creating some issues (for ex, HUDI-4138) in respect to the "hoodie.properties" lifecycle as most of the already existing code assumes that the file is (mostly) immutable.

We should re-evaluate our usage of "hoodie.properties" as a state-store given that it has ripple effects on the existing components.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-4185
- Type: Bug
- Fix version(s):
- 1.1.0

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.