aws-samples / aws-samples/aws-glue-samples
Sample for Searching Data Catalog
- Dominant language
- Python
- Stars
- 1.5k
- Forks
- 834
- Avg merge
- 2d 17h
- Merged PRs (30d)
- 1
Description
All over the web I've seen suggestions that Glue Data Catalog enables metadata searches....so that for example I could ask for all tables that contain a certain column name or that have a particular comment on a column.
To date I've not seen a single tutorial, sample, guide, how to, cheat sheet or any documentation of any kind that actually shows how to search for a column name in the Glue Data Catalog. The closest I've come is [this article](http://docs.awssolutionsbuilder.com/data-lake/user-guide/searching-in-data-lake/) which suggests that I can use these keywords when searching Glue Tables:
- column_name
- column_comment
- table_desc
When I try using one of these (e.g. `column_name: star*`) it always returns nothing, even though I do have tables that have a column named with "star".
This capability is far too basic and obviously needed, and thus warrants having a sample or some documentation created somewhere.
Contributor guide
Research direction
Start by reviewing the linked AWS Solutions Builder article and verifying whether Glue Data Catalog supports searches for column names, comments, and table descriptions as described. Done means the repository contains a sample or documentation that demonstrates the supported search behavior and explains the expected results.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws
- Domain
- cloud, databases, documentation
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100