apache / apache/iceberg-rust

idea: Build Iceberg Kernel to make it more extensible for users

Open
#1,817 2 comments 8 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
1.4k
Forks
567
Avg merge
2d 2h
Merged PRs (30d)
93

Description

I think it’s a great idea to split iceberg-kernel so we can separate the planning and execution stages.

We can follow delta-rs’s pattern to build it, providing a good abstraction for users to implement their own engine. In this kernel, we’ll let users plug in their own file IO and execution engine.

## Tasks

- [ ] https://github.com/apache/iceberg-rust/issues/1819
- [x] https://github.com/apache/iceberg-rust/issues/1314

Contributor guide

Open the contributing guide

Research direction

Start by reviewing linked issue #1819 and the completed issue #1314 to understand the existing work and boundaries. Define what separating planning from execution requires, including the user-provided file I/O and execution-engine abstractions. Done means an agreed kernel design that makes those components pluggable.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.