dbt-labs / dbt-labs/docs.getdbt.com

Document BigQuery job continuation and partial-parsing behavior

Open
#9,604 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
215
Forks
1.2k
Avg merge
1d 15h
Merged PRs (30d)
130

Description

### Contributions

- [x] I have read the [contribution guide](https://github.com/dbt-labs/docs.getdbt.com/blob/current/CONTRIBUTING.md).

### Link to page

- https://docs.getdbt.com/reference/resource-configs/bigquery-configs
- https://docs.getdbt.com/reference/parsing

### Describe the problem

dbt-adapters issue https://github.com/dbt-labs/dbt-adapters/issues/2070 proposes an opt-in `job_continuation_key` for dbt-bigquery. A later dbt invocation can use the same key to attach to matching BigQuery query/copy jobs and continue dbt's materialization control flow.

The parsing reference also says every environment-variable change in `profiles.yml` causes a full parse. Since dbt-core #9844, Python dbt hashes only credential values exposed through `connection_info()` / `{{ target }}`. Runtime-only credential fields deliberately omitted from `_connection_keys()` do not change that hash.

### Describe the improvement

- Document the `job_continuation_key` BigQuery profile option, its opt-in semantics, and an environment-variable example.
- State that the raw key is not included in BigQuery job IDs or logs.
- State that the field is runtime-only and unavailable through `{{ target }}` or `dbt debug`.
- Clarify the Python dbt partial-parsing documentation so it distinguishes target-visible profile values from runtime-only credential values.
- Note that Fusion support is separate until it implements an equivalent runtime-only transport.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the linked BigQuery configurations and parsing reference pages, then review the dbt-adapters issue and dbt-core #9844 for the stated behavior. Update both documentation areas to cover the opt-in job_continuation_key, its environment-variable example and runtime-only limitations, and distinguish target-visible values from runtime-only credentials, including the separate Fusion support note.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
documentation
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Clearly specified
Newbie friendliness
72/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.