apache / apache/paimon-cpp

[Feature] Support Lance file format

已關閉
#313 1 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
主要語言
C++
星號
65
分支
25
平均合併
2 天 9 小時
30 天內合併 PR
82

描述

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/paimon-cpp/issues) and found nothing similar.

### Motivation

Apache Paimon Java supports Lance as a data file format through the paimon-lance module. Paimon C++ currently cannot read or write tables configured with file.format=lance, which prevents Java and C++ engines from interoperating on those tables.

### Solution

Add optional Lance file format support to Paimon C++, aligned with the Java implementation and Lance 0.39.0:

- register a Lance file format factory behind a disabled-by-default CMake option;
- support reading and writing Lance files through the existing file format interfaces;
- support column projection, precise row selection, row counts, and file row-id reporting;
- validate the same supported and unsupported logical types as Java;
- add C++ round-trip tests and Java/C++ compatibility fixtures in both directions.

The implementation should follow the existing Mosaic Rust FFI integration and lifecycle patterns.

### Anything else?

Java reference module: https://github.com/apache/paimon/tree/master/paimon-lance

### Are you willing to submit a PR?

- [x] I am willing to submit a PR!

貢獻指南

開啟貢獻指南

研究方向

先閱讀現有的 Mosaic Rust FFI 整合與生命週期模式,接著比較 paimon-lance 中的 Java 參考模組,並檢查現有的檔案格式介面。完成的標準是:一個預設停用的選用 CMake 整合支援 Lance 的讀取與寫入、必要的投影與列選取、列中繼資料、邏輯型別驗證、往返測試,以及 Java/C++ 相容性 fixtures。

由索引模型根據 Issue 內容生成。

評估

技術堆疊
cmake, cpp, java, rust
領域
data-engineering, databases
Issue 類型
功能
難度
5/5
預估耗時
一週以上
活躍度
活躍
描述清晰度
基本清楚
新手友好度
45/100

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。