apache / apache/incubator-xtable

Improve catalog sync docs to do similar syncs in Glue and Snowflake as BLMS

Open
#548 0 comments 0 reactions 0 assignees View on GitHub
documentation
Dominant language
Java
Stars
1.2k
Forks
212
Avg merge
4d 9h
Merged PRs (30d)
16

Description

### Feature Request / Improvement

Right now only BLMS example uses `catalog.yaml` whereas Glue uses Crawler and Snowflake uses `metadata.json` path, both work but not the best way to deploy in production.

So show sample ways to sync to Glue and Snowflake catalogs automatically using a `catalog.yaml` file.

### Are you willing to submit PR?

- [X] Yes I am willing to submit a PR!

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the existing BLMS catalog.yaml example, then compare the current Glue Crawler approach and Snowflake metadata.json path described in the issue. Documentation is done when it includes sample production-oriented ways to use catalog.yaml for automatic Glue and Snowflake catalog synchronization.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws
Domain
data, documentation
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.