apache / apache/fluss

Remove TableInfo from server MetadataCache

Open
#982 2 comments 0 reactions 0 assignees View on GitHub
component=server
Dominant language
Java
Stars
2.2k
Forks
627
Avg merge
2d 20h
Merged PRs (30d)
119

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/alibaba/fluss/issues) and found nothing similar.

### Motivation

Currently, all the `TableInfo` is passed to `TabletServer` by UpdateMetadata RPC which is a big overhead during starting and occupies a lot memory of `TabletServer`. However, the `TableInfo` is not necessary for metadata cache and can be avoid for network transporting and memory storing. See comment: https://github.com/alibaba/fluss/pull/890#discussion_r2121199632

### Solution

_No response_

### Anything else?

_No response_

### Willingness to contribute

- [ ] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

Trace the UpdateMetadata RPC into TabletServer and its metadata cache, then read the linked discussion in pull request 890 for context. The issue is done when TableInfo is no longer transported by that update path or retained in the server metadata cache without breaking metadata handling.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend, distributed-systems
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.