[Feature] Support Vortex file format
- 主要语言
- C++
- 星标
- 65
- 派生
- 25
- 平均合并
- 2 天 12 小时
- 30 天内合并 PR
- 80
描述
### Search before asking
- [x] I searched in the [issues](https://github.com/apache/paimon-cpp/issues) and found nothing similar.
### Motivation
Apache Paimon Java supports Vortex through the paimon-vortex module, a Rust-based columnar file format with extensible compression encodings and lazily loaded summary statistics. Paimon C++ cannot currently access tables using this format.
### Solution
Add Vortex support to the Paimon C++ file-format SPI:
- Register the vortex file-format factory.
- Implement compatible schema, reader, and writer handling.
- Support column projection, predicate pushdown, and precise row selection.
- Validate the same supported and unsupported logical types as Java.
- Add C++ round-trip tests and Java-produced file compatibility tests.
### Anything else?
Vortex is implemented in Rust, so the integration can follow the Mosaic Rust FFI patterns (#238).
Java reference module: https://github.com/apache/paimon/tree/master/paimon-vortex
### Are you willing to submit a PR?
- [x] I'm willing to submit a PR!
贡献指南
调研方向
首先阅读 paimon-vortex 中的 Java 参考模块,以及 issue #238 中的 Mosaic Rust FFI 模式。将 C++ 文件格式 SPI 要求映射到所请求的 schema、reader、writer、projection、predicate 和 row-selection 行为。完成标准是:C++ 往返测试和 Java 生成文件兼容性测试覆盖受支持和不受支持的逻辑类型。
由索引模型根据 Issue 内容生成。
评估
- 技术栈
- cpp, java, rust
- 领域
- data-engineering, databases
- Issue 类型
- 功能
- 难度
- 5/5
- 预计耗时
- 一周以上
- 活跃度
- 活跃
- 描述清晰度
- 基本清楚
- 新手友好度
- 35/100