apache / apache/paimon-cpp

[Feature] Support Mosaic file format

Offen
#236 0 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
enhancement
Vorherrschende Sprache
C++
Sterne
65
Forks
25
Ø Merge
2 T. 12 Std.
Gemergte PRs (30 T.)
80

Beschreibung

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/paimon-cpp/issues) and found nothing similar.

### Motivation

Apache Paimon Java 2.0 supports Mosaic, a hybrid format designed for wide tables using column bucketing and parallel I/O. Paimon C++ cannot currently access tables using this format.

### Solution

Add Mosaic support to the Paimon C++ file-format SPI:
- Register the mosaic file-format factory.
- Implement compatible schema, reader, writer, and statistics handling.
- Support column projection and Mosaic column-bucket metadata.
- Add C++ round-trip tests and Java-produced file compatibility tests.

### Anything else?

We will also support formats such as Lance and Vortex in the future.

### Are you willing to submit a PR?

- [x] I'm willing to submit a PR!

Beitragsleitfaden

Beitragsleitfaden öffnen

Rechercherichtung

Start by tracing the Paimon C++ file-format SPI and comparing its current schema, reader, writer, and statistics handling with Apache Paimon Java 2.0's Mosaic behavior. The work is done when Mosaic is registered, projection and column-bucket metadata are supported, and C++ round-trip plus Java-produced compatibility tests pass.

Vom Indexierungsmodell aus dem Issue-Text verfasst.

Bewertung

Tech-Stack
cpp
Bereich
databases
Issue-Typ
Feature
Schwierigkeit
5/5
Geschätzter Aufwand
Über eine Woche
Aktivitätsstatus
Aktiv
Klarheit
Größtenteils klar
Anfängerfreundlichkeit
35/100

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.