[Feature] Support Lance file format
- 主要語言
- C++
- 星號
- 65
- 分支
- 25
- 平均合併
- 2 天 9 小時
- 30 天內合併 PR
- 82
描述
### Search before asking
- [x] I searched in the [issues](https://github.com/apache/paimon-cpp/issues) and found nothing similar.
### Motivation
Apache Paimon Java supports Lance as a data file format through the paimon-lance module. Paimon C++ currently cannot read or write tables configured with file.format=lance, which prevents Java and C++ engines from interoperating on those tables.
### Solution
Add optional Lance file format support to Paimon C++, aligned with the Java implementation and Lance 0.39.0:
- register a Lance file format factory behind a disabled-by-default CMake option;
- support reading and writing Lance files through the existing file format interfaces;
- support column projection, precise row selection, row counts, and file row-id reporting;
- validate the same supported and unsupported logical types as Java;
- add C++ round-trip tests and Java/C++ compatibility fixtures in both directions.
The implementation should follow the existing Mosaic Rust FFI integration and lifecycle patterns.
### Anything else?
Java reference module: https://github.com/apache/paimon/tree/master/paimon-lance
### Are you willing to submit a PR?
- [x] I am willing to submit a PR!
貢獻指南
研究方向
先閱讀現有的 Mosaic Rust FFI 整合與生命週期模式,接著比較 paimon-lance 中的 Java 參考模組,並檢查現有的檔案格式介面。完成的標準是:一個預設停用的選用 CMake 整合支援 Lance 的讀取與寫入、必要的投影與列選取、列中繼資料、邏輯型別驗證、往返測試,以及 Java/C++ 相容性 fixtures。
由索引模型根據 Issue 內容生成。
評估
- 技術堆疊
- cmake, cpp, java, rust
- 領域
- data-engineering, databases
- Issue 類型
- 功能
- 難度
- 5/5
- 預估耗時
- 一週以上
- 活躍度
- 活躍
- 描述清晰度
- 基本清楚
- 新手友好度
- 45/100