aws-samples / aws-samples/dbt-glue
Add table properties to the tables created by DBT on the AWS Glue Catalog
- Dominant language
- Python
- Stars
- 147
- Forks
- 96
- Avg merge
- 7h 4m
- Merged PRs (30d)
- 5
Description
### Describe the feature
Currently, AWS Glue allows to create tables with properties. This properties can be useful to add information like:
* who created this table?
* department that owns ?
* Is there any PII data?
### Describe alternatives you've considered
Properties could be added on the dbt_project file or as jinja code in each table
### Who will this benefit?
Different customers that need to have more metadata to filter their tables
### Are you interested in contributing this feature?
sure!
Contributor guide
Research direction
Start by locating the code that creates tables in the dbt-glue adapter and reviewing how it calls the AWS Glue Catalog. Determine how table properties should be configured and passed through from a dbt project or model. Done means newly created Catalog tables contain the requested metadata properties, with coverage for the chosen configuration path.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, python
- Domain
- cloud, data-engineering, databases
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100