ClickHouse / ClickHouse/dbt-clickhouse
Implementing Support for Catalog Integrations
- Dominant language
- Python
- Stars
- 362
- Forks
- 177
- Avg merge
- 2d 10h
- Merged PRs (30d)
- 8
Description
### Description
dbt Core v1.10 introduces [Iceberg data catalog support](https://github.com/dbt-labs/dbt-core/discussions/7834), allowing adapters to materialize models into both built-in and external catalogs that manage open table formats (like Iceberg).
This feature lets dbt projects manage datasets in object storage with a warehouse-agnostic interface and centralize catalog configuration.
Our adapter needs to implement this functionality so that users can:
* Materialize dbt models as Iceberg tables (or other supported open table formats).
* Register these tables in supported catalogs (e.g., AWS Glue, Hive Metastore).
* Query those tables through ClickHouse with dbt.
### Tasks (we'll add more tasks over time)
- [ ] Review dbt Core v1.10 adapter catalog integration docs and implementation guidelines.
- [ ] Add adapter methods required for catalog integration (list_catalogs, create_table_with_catalog, etc.).
- [ ] Ensure correct handling of metadata registration in supported catalogs.
- [ ] Add configuration support for catalog parameters (catalog type, location, table format, etc.).
- [ ] Implement integration tests for catalog-based materializations.
Contributor guide
Research direction
Start by reviewing the dbt Core v1.10 adapter catalog integration documentation and implementation guidelines. Then inspect the adapter's catalog methods and configuration requirements named in the tasks; the work is done when catalog materializations, metadata registration, catalog parameters, and integration tests support the specified table formats and catalogs.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- clickhouse, python
- Domain
- data-engineering, databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100