dbt-labs / dbt-labs/docs.getdbt.com

bigquery_reject_wildcard_metadata_source_freshness flag add suggestion on loaded_at_field

Open
#8,865 0 comments 0 reactions 0 assignees View on GitHub
content improvement
Dominant language
JavaScript
Stars
215
Forks
1.2k
Avg merge
1d 15h
Merged PRs (30d)
130

Description

### Contributions

- [x] I have read the contribution docs, and understand what's expected of me.

### Link to the page on docs.getdbt.com requiring updates

https://docs.getdbt.com/reference/global-configs/bigquery-changes?version=2.0#the-bigquery_reject_wildcard_metadata_source_freshness-flag

### What part(s) of the page would you like to see updated?

Can we add the suggestion to use the [_TABLE_SUFFIX](https://docs.cloud.google.com/bigquery/docs/querying-wildcard-tables) field for the freshness when possible? This would save the user quite a bit of compute and money.

In a lot of cases, the table _TABLE_SUFFIX field will be transformable to a date, so then you can use it as a freshness field. And querying on a field in the table will do a full table scan, while _TABLE_SUFFIX is free for on-demand pricing and less slot time for slots..

Image

### Additional information

_No response_

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.