apache / apache/fluss

Add compression for CompactedRow

Open
#2,806 0 comments 0 reactions 0 assignees View on GitHub
component=log
Dominant language
Java
Stars
2.1k
Forks
625
Avg merge
3d 14h
Merged PRs (30d)
97

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/fluss/issues) and found nothing similar.

### Motivation

In Fluss 0.9, we introduced the CompactedRow format on the log.
https://fluss.apache.org/docs/table-design/data-formats/
However, compared to the arrow format, we do still need to add compression to make this feature complete

### Solution

_No response_

### Anything else?

_No response_

### Willingness to contribute

- [ ] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading the CompactedRow and Arrow format documentation linked in the issue, then locate the existing CompactedRow implementation and the Arrow compression path. The issue provides no target files or proposed design; done means defining and implementing compression for CompactedRow so the format is complete relative to Arrow.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.