aws-samples / aws-samples/dbt-glue

Add table properties to the tables created by DBT on the AWS Glue Catalog

Open
#59 2 comments 2 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
147
Forks
96
Avg merge
7h 4m
Merged PRs (30d)
5

Description

### Describe the feature
Currently, AWS Glue allows to create tables with properties. This properties can be useful to add information like:
* who created this table?
* department that owns ?
* Is there any PII data?

### Describe alternatives you've considered
Properties could be added on the dbt_project file or as jinja code in each table

### Who will this benefit?
Different customers that need to have more metadata to filter their tables

### Are you interested in contributing this feature?
sure!

Contributor guide

Open the contributing guide

Research direction

Start by locating the code that creates tables in the dbt-glue adapter and reviewing how it calls the AWS Glue Catalog. Determine how table properties should be configured and passed through from a dbt project or model. Done means newly created Catalog tables contain the requested metadata properties, with coverage for the chosen configuration path.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python
Domain
cloud, data-engineering, databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.