apache / apache/iceberg-rust

refactor(glue): derive catalog configuration from properties

Open
#3,096 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Rust
Stars
1.4k
Forks
567
Avg merge
2d 2h
Merged PRs (30d)
93

Description

Part of [apache/iceberg-rust#3094](https://github.com/apache/iceberg-rust/issues/3094).

## Is your feature request related to a problem or challenge?

`GlueCatalogBuilder::load` manually parses URI, catalog ID, and warehouse properties and filters the remaining AWS and storage properties.

## Describe the solution you would like

Use the `Properties` derive macro for the Glue catalog property projection while preserving optional URI and catalog ID handling, required warehouse validation, and forwarding all unmodeled AWS, FileIO, and KMS properties.

Acceptance criteria:
- Public builder APIs remain unchanged.
- URI, catalog ID, and warehouse behavior remains compatible.
- Recognized properties are excluded from the forwarded property map.
- Unknown AWS and storage properties remain available downstream.
- Focused unit tests cover defaults, overrides, validation, and property retention.

## Willingness to contribute

I can contribute to this feature independently.

Contributor guide

Open the contributing guide

Research direction

Locate GlueCatalogBuilder::load and inspect how URI, catalog ID, warehouse, AWS, FileIO, and KMS properties are currently projected. Read the Properties derive macro usage and run or add focused unit tests for defaults, overrides, validation, recognized-property filtering, and retention of unknown properties; done means public APIs and existing behavior remain compatible.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, rust
Domain
cloud, data-engineering
Issue type
Refactor
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
66/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.