aws-samples / aws-samples/aws-glue-samples

Sample for Searching Data Catalog

Open
#48 1 comment 1 reaction 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
1.5k
Forks
834
Avg merge
2d 17h
Merged PRs (30d)
1

Description

All over the web I've seen suggestions that Glue Data Catalog enables metadata searches....so that for example I could ask for all tables that contain a certain column name or that have a particular comment on a column.

To date I've not seen a single tutorial, sample, guide, how to, cheat sheet or any documentation of any kind that actually shows how to search for a column name in the Glue Data Catalog. The closest I've come is [this article](http://docs.awssolutionsbuilder.com/data-lake/user-guide/searching-in-data-lake/) which suggests that I can use these keywords when searching Glue Tables:

- column_name
- column_comment
- table_desc

When I try using one of these (e.g. `column_name: star*`) it always returns nothing, even though I do have tables that have a column named with "star".

This capability is far too basic and obviously needed, and thus warrants having a sample or some documentation created somewhere.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the linked AWS Solutions Builder article and verifying whether Glue Data Catalog supports searches for column names, comments, and table descriptions as described. Done means the repository contains a sample or documentation that demonstrates the supported search behavior and explains the expected results.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws
Domain
cloud, databases, documentation
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.