airbytehq / airbytehq/quickstarts

Non dbt command in the DbtCoreOperation in the dbt prefect bigquery quickstart

Open
#95 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
216
Forks
47
PR merge metrics
No merged PRs in 30d

Description

In the dbt prefect bigquery workflow, the [first command in the list](https://github.com/airbytehq/quickstarts/blob/ece888839f168025cb691671a1d9a848533f7eea/airbyte_dbt_prefect_bigquery/orchestration/my_elt_flow.py#L51) (`pwd`) fails because it's not a dbt command. Every command in the DbtCoreOperation is presumed to be a valid dbt command and `--profiles-dir` and `--project-dir` are appended during command run. when you append the commands to the bash command `pwd` (e.g `pwd --profiles-dir /some/dir --project-dir /some/dir`) it fails because it treats the appends as flags.

Weirdly, this does not trigger the task to fail. It only shows on the logs as an info. See screenshot below
![Screenshot from 2024-02-13 01-20-46](https://github.com/airbytehq/quickstarts/assets/10197807/9d52fe1f-992d-4971-930b-552ef5e64215)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.