ClickHouse / ClickHouse/dbt-clickhouse

Updates to table settings on incremental loads

Open
#608 0 comments 1 reaction 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
362
Forks
177
Avg merge
2d 10h
Merged PRs (30d)
8

Description

**Is your feature request related to a problem? Please describe.**
Currently when we make changes to model settings of `materialized='materialized_view'` the destination/target table is not getting updated unless we perform a --full-refresh. It should actually perform
```sql
ALTER TABLE my_table MODIFY SETTING setting_name = value [, ...]; or
ALTER TABLE my_table RESET SETTING setting_name [, ...];
```

**Describe the solution you'd like**
when the model settings are updated on incremental runs (i.e without --full-refresh), the underlying destination/target table settings should be updated.

**Additional context**
https://github.com/ClickHouse/dbt-clickhouse/pull/607 tests to validate the behavior

Contributor guide

Open the contributing guide

Research direction

Start with the incremental-run handling for models using materialized='materialized_view', then review the tests referenced in pull request #607. Verify that changing model settings without --full-refresh updates the destination table using the requested ALTER TABLE MODIFY SETTING or RESET SETTING behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
database
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.