aws-samples / aws-samples/dbt-glue

dbt run fails when the select returns zero rows

Open
#178 1 comment 0 reactions 0 assignees View on GitHub
bug
Dominant language
Python
Stars
147
Forks
96
Avg merge
7h 4m
Merged PRs (30d)
5

Description

`dbt run` for specific models fail as we are employing automated schema inference from the SQL output. How can we create tables with zero/empty rows using dbt-glue adapter?

I have checked that we can create empty tables in Apache HUDI by defining schema explicitly!

Contributor guide

Open the contributing guide

Research direction

The issue names dbt run, automated schema inference, and Apache Hudi but no files or tests. Start by reproducing a zero-row model with the dbt-glue adapter and compare it with the explicitly defined Hudi schema case; done means the model creates an empty table without failing.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, sql
Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.