apache / apache/fluss

Support Array/NestedRow/Map types in tiering service

Open
#1,980 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
2.1k
Forks
625
Avg merge
3d 14h
Merged PRs (30d)
97

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/fluss/issues) and found nothing similar.

### Motivation

Enable tiering service to handle complex types when moving data to remote storage.

### Solution

- Extend tiering format to support Array, NestedRow, and Map types
- Implement serialization/deserialization for complex types in tiering service
- Ensure tiering read/write operations work correctly with complex types
- Add tests for tiering service with complex types

### Anything else?

_No response_

### Willingness to contribute

- [ ] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the tiering service and its tiering format implementation, then review how existing primitive types are serialized and deserialized. Extend the format for Array, NestedRow, and Map values, and add tiering read/write tests demonstrating that complex types round-trip correctly.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.