aws-samples / aws-samples/dbt-glue

Allow adding write options to model configuration

Open
#415 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
147
Forks
96
Avg merge
7h 4m
Merged PRs (30d)
5

Description

### Describe the feature
I want to be able to add write options as model configuration.

### Describe alternatives you've considered
Add write option and passing it to the adapter create table function.

### Additional context
It allow solving problems seen in these issues (https://github.com/aws-samples/dbt-glue/issues/211 or https://github.com/aws-samples/dbt-glue/issues/159) : modifying the schema of a table at when --full-refresh is passed.

### Who will this benefit?
Everyone wanting more control on their write option and everyone using incremental strategy and wanting to full refresh their models.

### Are you interested in contributing this feature?
Yes I want to but I am very new to open source contributing and I would like information on how to be sure what I do is sufficient.

Contributor guide

Open the contributing guide

Research direction

Start by tracing model configuration into the adapter create-table path, then compare incremental models during --full-refresh with the cases described in issues 211 and 159. Done means write options can be configured on a model, reach the adapter create-table function, and address those schema-change scenarios.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.