apache / apache/iceberg-rust

Warehouse path is always required for Glue catalog, even when there isn't one

Open
#941 5 comments 2 reactions 0 assignees View on GitHub
bug not-stale stale
Dominant language
Rust
Stars
1.4k
Forks
567
Avg merge
2d 2h
Merged PRs (30d)
93

Description

The [warehouse](https://github.com/apache/iceberg-rust/blob/c754e27f752a9e2f86180a9b40f69a3d4ab2dae9/crates/catalog/glue/src/catalog.rs#L46) config prop for Glue catalog is required, but it isn't always known or required. The Glue catalog ID is enough in order to resolve metadata locations.

Moreover - I don't think this path is used for anything but protocol (FileIO type) inference? I was able to work around this issue by passing the correct Glue catalog ID (which is the AWS account ID) and `s3://` as the warehouse, with no issue.

In my opinion `warehouse` should be replaced with something like `FileIO` type and only the Glue catalog ID should be required, but for backwards compatibility not passing warehouse should at least be allowed.

Contributor guide

Open the contributing guide

Research direction

Start with crates/catalog/glue/src/catalog.rs around line 46 and trace how the Glue catalog ID and warehouse are used during catalog initialization. Verify the behavior when only the catalog ID is provided, then ensure metadata locations still resolve without a warehouse while preserving the existing configuration behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, rust
Domain
cloud, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.