dbt-labs / dbt-labs/docs.getdbt.com

[Bug] Incomplete documentation for using BigQuery DataFrames (python models)

Open
#7,824 1 comment 0 reactions 1 assignee Claimed by @matthewshaver View on GitHub
Dominant language
JavaScript
Stars
215
Forks
1.2k
Avg merge
1d 15h
Merged PRs (30d)
130

Description

### Is this a new bug?

- [x] I believe this is a new bug
- [x] I have searched the existing issues, and I could not find an existing issue for this bug

### Which packages are affected?

- [ ] dbt-adapters
- [ ] dbt-tests-adapter
- [ ] dbt-athena
- [ ] dbt-athena-community
- [x] dbt-bigquery
- [ ] dbt-postgres
- [ ] dbt-redshift
- [ ] dbt-snowflake
- [ ] dbt-spark

### Current Behavior

Here are the issues I've found while trying to follow the docs:
- missing info that setting `submission_method` to `bigframes` in `dbt_project.yml` or model config is required to use this feature instead of Dataproc, as described in https://cloud.google.com/bigquery/docs/dataframes-dbt#configurations (without setting this, an error is shown that you need to enable Dataproc API)
- it's unclear why `compute_region` should be specified when using oauth (shouldn't it be read automatically, same as the project?), and also, which region to specify (BigQuery has no region, and GCS buckets can be multi-region, eg. region can be `us`, while no such region exists as an option for `compute_region`)
- looks like enabling Vertex AI API is required:
```python
403 Vertex AI API has not been used in project my-project before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/aiplatform.googleapis.com/overview?project=my-project then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry.
```
It would also be great to know how/why dbt uses the Vertex AI service, because it's hard to understand what the connection may be if you're not already familiar with Vertex AI.

### Expected Behavior

Would be nice to be able to use BigQuery Dataframes instead of Dataproc for python models.

### Steps To Reproduce

Try to follow the instructions in dbt docs: https://docs.getdbt.com/docs/core/connect-data-platform/bigquery-setup

### Relevant log output

```shell

```

### Environment

```markdown
- OS:
- Python:
- dbt-adapters:
- :
```

### Additional Context

_No response_

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.