apache / apache/iceberg-rust

Can we trim the storage scheme after parsing?

Open
#1,411 8 comments 0 reactions 0 assignees View on GitHub
stale
Dominant language
Rust
Stars
1.4k
Forks
567
Avg merge
2d 2h
Merged PRs (30d)
93

Description

One question I have is whether we really need to keep the original `abfss` scheme. I don't recall any situation where we need to use it, perhaps only when creating a table? I wonder if we could simply remove it after parsing the input path.

_Originally posted by @Xuanwo in https://github.com/apache/iceberg-rust/issues/1368#issuecomment-2944696445_

Contributor guide

Open the contributing guide

Research direction

No file or test is named. Start by tracing where input paths are parsed and searching for every use of the `abfss` scheme, including table creation. Done means determining whether the scheme can be removed safely and adding coverage for the chosen behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
data-engineering
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.