apache / apache/hudi

Include instants outside commits and compaction for generating the latest instant and timeline hash for timeline server requests

Open
#16,424 1 comment 0 reactions 1 assignee Assigned to @yihua View on GitHub
area:table-service area:timeline from-jira priority:blocker type:bug
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

When the write client sends the request to the timeline server with the latest instant and timeline hash, the latest instant and timeline hash are based on the filtered timeline that does not contain pending log compaction or clustering (replacecommit).  In such a case, consecutive async scheduling of clustering, even with a newly instantiated write client, does not trigger FSV refresh at the timeline server; but FSV is affected by pending clustering and log compaction (e.g., fgIdToPendingLogCompaction, fgIdToReplaceInstants, fgIdToPendingClustering).

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-7527
- Type: Bug
- Fix version(s):
- 1.1.0

---

## Comments

01/Oct/24 00:31;yihua;[~shivnarayan] I deferred this to Hudi 1.1, since this does not affect the correctness.  Let me know otherwise.;;;

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.