[Feature] Support 64-bit deletion vectors in Paimon C++
- 主要语言
- C++
- 星标
- 65
- 派生
- 25
- 平均合并
- 2 天 12 小时
- 30 天内合并 PR
- 80
描述
### Search before asking
- [x] I searched in the [issues](https://github.com/apache/paimon-cpp/issues) and found nothing similar.
### Motivation
### Motivation
Java Paimon supports both 32-bit and 64-bit deletion vectors through:
```properties
deletion-vectors.enabled=true
deletion-vectors.bitmap64=true
Paimon C++ currently exposes the deletion-vectors.bitmap64 option, but bitmap64 deletion vectors are not implemented:
- include/paimon/defs.h marks bitmap64 DV as unsupported.
- DeletionVector::Read recognizes the bitmap64 magic number but returns NotImplemented.
- Only BitmapDeletionVector, backed by RoaringBitmap32, is currently used for deletion-vector reads and writes.
As a result, Paimon C++ cannot read tables containing bitmap64 deletion vectors produced by Java Paimon, and cannot produce Iceberg-compatible deletion vectors.
### Solution
_No response_
### Anything else?
_No response_
### Are you willing to submit a PR?
- [x] I'm willing to submit a PR!
贡献指南
调研方向
首先通过 include/paimon/defs.h 和 DeletionVector::Read 跟踪删除向量的处理,然后检查 BitmapDeletionVector 和 RoaringBitmap32 的读写路径。将现有的 bitmap32 行为与 bitmap64 的 magic number 以及 issue 中描述的 Java Paimon 属性进行比较。当 Paimon C++ 可以读取 Java 生成的 bitmap64 删除向量,并生成与 Iceberg 兼容的删除向量时,即表示完成。
由索引模型根据 Issue 内容生成。
评估
- 技术栈
- cpp
- 领域
- databases
- Issue 类型
- 功能
- 难度
- 4/5
- 预计耗时
- 3-5 天
- 活跃度
- 活跃
- 描述清晰度
- 基本清楚
- 新手友好度
- 45/100