aws-samples / aws-samples/dbt-glue
Allow adding write options to model configuration
- Dominant language
- Python
- Stars
- 147
- Forks
- 96
- Avg merge
- 7h 4m
- Merged PRs (30d)
- 5
Description
### Describe the feature
I want to be able to add write options as model configuration.
### Describe alternatives you've considered
Add write option and passing it to the adapter create table function.
### Additional context
It allow solving problems seen in these issues (https://github.com/aws-samples/dbt-glue/issues/211 or https://github.com/aws-samples/dbt-glue/issues/159) : modifying the schema of a table at when --full-refresh is passed.
### Who will this benefit?
Everyone wanting more control on their write option and everyone using incremental strategy and wanting to full refresh their models.
### Are you interested in contributing this feature?
Yes I want to but I am very new to open source contributing and I would like information on how to be sure what I do is sufficient.
Contributor guide
Research direction
Start by tracing model configuration into the adapter create-table path, then compare incremental models during --full-refresh with the cases described in issues 211 and 159. Done means write options can be configured on a model, reach the adapter create-table function, and address those schema-change scenarios.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100