dbt-labs / dbt-labs/dbt-adapters

[Feature] Display the amount of processed data when running tests

Open
#570 3 comments 2 reactions 0 assignees View on GitHub
feature:cost-reduction pkg:dbt-bigquery type:enhancement
Dominant language
Python
Stars
233
Forks
362
Avg merge
3d 22h
Merged PRs (30d)
9

Description

### Is this your first time submitting a feature request?

- [X] I have read the [expectations for open source contributors](https://docs.getdbt.com/docs/contributing/oss-expectations)
- [X] I have searched the existing issues, and I could not find an existing issue for this feature
- [X] I am requesting a straightforward extension of existing dbt functionality, rather than a Big Idea better suited to a discussion

### Describe the feature

When executing the run or build command, dbt displays the amount of data processed to create tables, I think it would be nice it also displayed the amount of data processed when running tests

### Describe alternatives you've considered

_No response_

### Who will this benefit?

We had a situation that after writing some new models, a chart in a report tracking the amount of processed data in BigQuery showed a very sharp increase... we looked at the output from dbt and found that it was processing a lot of data to create some tables, we fixed that but the amount of data processed still increased more than expected, we learned that we had missed some tests that were scanning a lot of the same data and refactored the tests downstream to other models.

### Are you interested in contributing this feature?

Yes but I don't know the codebase, no idea where I would start.

### Anything else?

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.