apache / apache/paimon-cpp

[Feature] Support 64-bit deletion vectors in Paimon C++

未關閉
#325 0 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
enhancement
主要語言
C++
星號
65
分支
25
平均合併
2 天 9 小時
30 天內合併 PR
82

描述

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/paimon-cpp/issues) and found nothing similar.

### Motivation

### Motivation

Java Paimon supports both 32-bit and 64-bit deletion vectors through:

```properties
deletion-vectors.enabled=true
deletion-vectors.bitmap64=true

Paimon C++ currently exposes the deletion-vectors.bitmap64 option, but bitmap64 deletion vectors are not implemented:
- include/paimon/defs.h marks bitmap64 DV as unsupported.
- DeletionVector::Read recognizes the bitmap64 magic number but returns NotImplemented.
- Only BitmapDeletionVector, backed by RoaringBitmap32, is currently used for deletion-vector reads and writes.
As a result, Paimon C++ cannot read tables containing bitmap64 deletion vectors produced by Java Paimon, and cannot produce Iceberg-compatible deletion vectors.

### Solution

_No response_

### Anything else?

_No response_

### Are you willing to submit a PR?

- [x] I'm willing to submit a PR!

貢獻指南

開啟貢獻指南

研究方向

首先透過 include/paimon/defs.h 和 DeletionVector::Read 追蹤刪除向量的處理,接著檢查 BitmapDeletionVector 和 RoaringBitmap32 的讀寫路徑。將現有的 bitmap32 行為與 bitmap64 的 magic number 以及 issue 中描述的 Java Paimon 屬性進行比較。當 Paimon C++ 可以讀取 Java 產生的 bitmap64 刪除向量,並產生與 Iceberg 相容的刪除向量時,即表示完成。

由索引模型根據 Issue 內容生成。

評估

技術堆疊
cpp
領域
databases
Issue 類型
功能
難度
4/5
預估耗時
3-5 天
活躍度
活躍
描述清晰度
基本清楚
新手友好度
45/100

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。