datafusion-contrib / datafusion-contrib/datafusion-distributed
[Iceberg] Support partitioning in work-unit feeds
Open
@sandugood is already working on this.
Since Sep 12, 2026.
- Dominant language
- Rust
- Stars
- 139
- Forks
- 67
- Avg merge
- 3d 1h
- Merged PRs (30d)
- 35
Description
Part of #599.
Extend IcebergWorkUnitFeed beyond Partitioning::UnknownPartitioning to support hash and range partitioning, including routing scan tasks according to the requested output partitioning.
Essentially, implementing these TODO comments in the code:
This needs to define which requested partitioning schemes can actually be satisfied from Iceberg scan tasks, then route the tasks without violating those semantics.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.