GoogleCloudPlatform / GoogleCloudPlatform/professional-services-data-validator

Lack of support for BIGNUMERIC when using duckdb backend.

Open
#1,760 0 comments 0 reactions 0 assignees View on GitHub
type: bug
Dominant language
Python
Stars
524
Forks
171
Avg merge
5d 15h
Merged PRs (30d)
4

Description

**Describe the bug**
The Duckdb backend does not support Google BigNumeric. Any data with more than 38 digits of precision will fail with the Duckdb backend.

**What version of DVT are you using?**
Probably DVT version 9 and later.

**What type of connections are you using for source and target?**
BigQuery for Source and Target.

**Steps to reproduce the behavior**
See test `test_numeric_types` in [test_bigquery.py](tests/system/data_sources/test_bigquery.py)

**Expected behavior**
A clear and concise description of what you expected to happen.

**Screenshots**
If applicable, add screenshots to help explain your problem.

**How are you executing DVT?**
Ex: CLI commands on local computer or VM, within a DAG, Cloud Run job, etc

**Additional context**
Add any other context about the problem here.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.