ClickHouse / ClickHouse/dbt-clickhouse

Implementing Support for Catalog Integrations

Open
#489 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
362
Forks
177
Avg merge
2d 10h
Merged PRs (30d)
8

Description

### Description

dbt Core v1.10 introduces [Iceberg data catalog support](https://github.com/dbt-labs/dbt-core/discussions/7834), allowing adapters to materialize models into both built-in and external catalogs that manage open table formats (like Iceberg).

This feature lets dbt projects manage datasets in object storage with a warehouse-agnostic interface and centralize catalog configuration.

Our adapter needs to implement this functionality so that users can:

* Materialize dbt models as Iceberg tables (or other supported open table formats).

* Register these tables in supported catalogs (e.g., AWS Glue, Hive Metastore).

* Query those tables through ClickHouse with dbt.

### Tasks (we'll add more tasks over time)

- [ ] Review dbt Core v1.10 adapter catalog integration docs and implementation guidelines.

- [ ] Add adapter methods required for catalog integration (list_catalogs, create_table_with_catalog, etc.).

- [ ] Ensure correct handling of metadata registration in supported catalogs.

- [ ] Add configuration support for catalog parameters (catalog type, location, table format, etc.).

- [ ] Implement integration tests for catalog-based materializations.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the dbt Core v1.10 adapter catalog integration documentation and implementation guidelines. Then inspect the adapter's catalog methods and configuration requirements named in the tasks; the work is done when catalog materializations, metadata registration, catalog parameters, and integration tests support the specified table formats and catalogs.

Written by the indexing model from the issue text.

Assessment

Tech stack
clickhouse, python
Domain
data-engineering, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.