apache / apache/fluss

[client] Refactor metadata cache and async updating mechanism and retry mechanism in client side

Open
#483 2 comments 0 reactions 1 assignee Claimed by @wuchong View on GitHub
component=client
Dominant language
Java
Stars
2.1k
Forks
625
Avg merge
3d 14h
Merged PRs (30d)
97

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/alibaba/fluss/issues) and found nothing similar.

### Motivation

Currently, the implementation of metadata cache (`Cluster`) and updating mechanism (`MetadataUpdater`) on the client side is not very sophisticated. It lacks the general retry mechanism (#480), the time out for `UpdateMetadata` request is too short to cause job failover (#311), cause job failover when a new partition created (#288).

### Solution

This issue aims to introduce a new design of metadata cache and updating mechanism, to resolve above problems.

### Anything else?

_No response_

### Willingness to contribute

- [x] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.