NVIDIA / NVIDIA/cudf

[FEA] DataLake Iceberg, delta lake, hudi support

Open
#21,732 5 comments 0 reactions 0 assignees View on GitHub
cuIO feature request
Dominant language
C++
Stars
9.8k
Forks
1.1k
Avg merge
3d 6m
Merged PRs (30d)
278

Description

**Is your feature request related to a problem? Please describe.**
As modern lakehouse system has moved to Data lake such as Iceberg for data skipping, transaction, schema evolution, how can we support it in cudf? Velox has implemented the iceberg read which is mostly like hive, but read deletes is a big challenge for cudf, the delete is a totally different format like V3 deletion vector.

**Describe the solution you'd like**
A clear and concise description of what you want to happen.
Support iceberg read data files first.

**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.

**Additional context**
Add any other context, code examples, or references to existing implementations about the feature request here.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.