dbt-labs / dbt-labs/dbt-adapters
[ADAP-426] [Feature] Add Flag to the Profile to Redact User Data from Logs
- Dominant language
- Python
- Stars
- 233
- Forks
- 362
- Avg merge
- 3d 22h
- Merged PRs (30d)
- 9
Description
### Is this your first time submitting a feature request?
- [X] I have read the [expectations for open source contributors](https://docs.getdbt.com/docs/contributing/oss-expectations)
- [X] I have searched the existing issues, and I could not find an existing issue for this feature
- [X] I am requesting a straightforward extension of existing dbt-snowflake functionality, rather than a Big Idea better suited to a discussion
### Describe the feature
In PR dbt-labs/dbt-snowflake#378 a change was made to redact data from the dbt logs on a failed model e.g. due to duplicate data during a dbt run. While this behavior is useful, it ought to be configurable such that developers can disable the redaction whilst investigating a failed model. The end user can also then decide whether data redaction is suitable for them or whether it grants more benefit to show data in the logs.
I would suggest that if the new config option isn't present then data ought to be redacted by default, it should be an explicit choice from the user to not redact data.
### Describe alternatives you've considered
_No response_
### Who will this benefit?
Developers investigating failing models
Users that do not require data redaction
### Are you interested in contributing this feature?
Yes, I've begun to take a look at the code, though I am currently struggling to get the functional tests to run on a fresh checkout I suspect due to authorisation with my Snowflake Account.
### Anything else?
Relevant section of code is at https://github.com/dbt-labs/dbt-snowflake/blob/main/dbt/adapters/snowflake/connections.py#L263
Contributor guide
Assessment
This issue has not been assessed yet.