dbt-labs / dbt-labs/dbt-adapters

[Bug] table properties are not being passed for Hudi spark

Open
#1,044 4 comments 0 reactions 0 assignees View on GitHub
pkg:dbt-spark triage:quick_support_task type:bug
Dominant language
Python
Stars
233
Forks
362
Avg merge
3d 22h
Merged PRs (30d)
9

Description

### Is this a new bug?

- [x] I believe this is a new bug
- [x] I have searched the existing issues, and I could not find an existing issue for this bug

### Which packages are affected?

- [ ] dbt-adapters
- [ ] dbt-tests-adapter
- [ ] dbt-athena
- [ ] dbt-athena-community
- [ ] dbt-bigquery
- [ ] dbt-postgres
- [ ] dbt-redshift
- [ ] dbt-snowflake
- [x] dbt-spark

### Current Behavior

I should be able to do

```
seeds:
jaffle_shop:
+schema: dbt_raw
+file_format: hudi
+location_root: s3://lakehouse-albert-us-west-2/demolake/dbt_raw
+tblproperties:
hudi.table.type: mor
```

### Expected Behavior

creates a merge on read MOR table but it creates a copy on write table which is the default for spark sql.

### Steps To Reproduce

see above

### Relevant log output

table properties are not being passed into create table.
```shell
21:06:11 On seed.jaffle_shop.raw_stores: /* {"app": "dbt", "dbt_version": "2025.4.8+634b9ce", "profile_name": "user", "target_name": "default", "node_id": "seed.jaffle_shop.raw_stores"} */

create table dbt_raw.raw_stores (`id` string,`name` string,`opened_at` timestamp,`tax_rate` double)

using hudi



location 's3://lakehouse-albert-us-west-2/demolake/dbt_raw/raw_stores'
```

### Environment

```markdown
- OS:
- Python:
- dbt-adapters:
- :
```

### Additional Context

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.