GoogleCloudPlatform / GoogleCloudPlatform/professional-services-data-validator

ERROR-2:sqlalchemy.exc.ProgrammingError: (psycopg2.errors.UndefinedObject) unrecognized configuration parameter "standard_conforming_strings"

Open
#1,563 10 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
524
Forks
171
Avg merge
5d 15h
Merged PRs (30d)
4

Description

@nj1973
@helensilva14

**Describe the bug**
- data-validation CLI tool fails with FileNotFoundError for connection configuration files when executed via Terraform's local-exec provisioner. The data-validation validate command cannot find the connection files (REDSHIFT_CONN_CTD.connection.json ) that were supposedly created by the data-validation connections add commands earlier in the same script. The error path suggests the files are expected in a user home directory (/builder/home/.config/google-pso-data-validator/), but they were likely created in a different temporary or working directory.

**version of DVT**
- 8.0.0

**Type of connections are you using for source and target**
- Source: Redshift
- Target: BigQuery

**Steps to reproduce the behavior**
1. Set up a Python virtual environment.
2. Install google-pso-data-validator.
3. Add Redshift and BigQuery connections using data-validation connections add.
4. Immediately attempt to run data-validation validate commands.
5. The validate command fails with a FileNotFoundError.

**Error Logs:**
```
│ File "/workspace/data-cloud/Data Warehouse Migration-591/demo/terraform/DWMH_Validation_Automation/.venv/lib/python3.11/site-packages/data_validation/gcs_helper.py", line 82, in read_file
│ with open(file_path, "r") as f:
│ ^^^^^^^^^^^^^^^^^^^^
│ FileNotFoundError: [Errno 2] No such file or directory:
│ '/builder/home/.config/google-pso-data-validator/REDSHIFT_CONN_CTD.connection.json'
│ ERROR:root:Exception No module named 'ibm_db_dbi' while importing
│ db2_connect

│ File "/workspace/data-cloud/Data Warehouse Migration-591/demo/terraform/DWMH_Validation_Automation/.venv/lib/python3.11/site-packages/data_validation/gcs_helper.py", line 82, in read_file
│ with open(file_path, "r") as f:
│ ^^^^^^^^^^^^^^^^^^^^
│ FileNotFoundError: [Errno 2] No such file or directory:
│ '/builder/home/.config/google-pso-data-validator/REDSHIFT_CONN_CTD.connection.json'
│ ERROR:root:Exception No module named 'ibm_db_dbi' while importing
│ db2_connect

│ File "/workspace/data-cloud/Data Warehouse Migration-591/demo/terraform/DWMH_Validation_Automation/.venv/lib/python3.11/site-packages/data_validation/gcs_helper.py", line 82, in read_file
│ with open(file_path, "r") as f:
│ ^^^^^^^^^^^^^^^^^^^^
│ FileNotFoundError: [Errno 2] No such file or directory:
│ '/builder/home/.config/google-pso-data-validator/REDSHIFT_CONN_CTD.connection.json'
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.