GoogleCloudPlatform / GoogleCloudPlatform/professional-services-data-validator
ERROR-2:sqlalchemy.exc.ProgrammingError: (psycopg2.errors.UndefinedObject) unrecognized configuration parameter "standard_conforming_strings"
- Dominant language
- Python
- Stars
- 524
- Forks
- 171
- Avg merge
- 5d 15h
- Merged PRs (30d)
- 4
Description
@nj1973
@helensilva14
**Describe the bug**
- data-validation CLI tool fails with FileNotFoundError for connection configuration files when executed via Terraform's local-exec provisioner. The data-validation validate command cannot find the connection files (REDSHIFT_CONN_CTD.connection.json ) that were supposedly created by the data-validation connections add commands earlier in the same script. The error path suggests the files are expected in a user home directory (/builder/home/.config/google-pso-data-validator/), but they were likely created in a different temporary or working directory.
**version of DVT**
- 8.0.0
**Type of connections are you using for source and target**
- Source: Redshift
- Target: BigQuery
**Steps to reproduce the behavior**
1. Set up a Python virtual environment.
2. Install google-pso-data-validator.
3. Add Redshift and BigQuery connections using data-validation connections add.
4. Immediately attempt to run data-validation validate commands.
5. The validate command fails with a FileNotFoundError.
**Error Logs:**
```
│ File "/workspace/data-cloud/Data Warehouse Migration-591/demo/terraform/DWMH_Validation_Automation/.venv/lib/python3.11/site-packages/data_validation/gcs_helper.py", line 82, in read_file
│ with open(file_path, "r") as f:
│ ^^^^^^^^^^^^^^^^^^^^
│ FileNotFoundError: [Errno 2] No such file or directory:
│ '/builder/home/.config/google-pso-data-validator/REDSHIFT_CONN_CTD.connection.json'
│ ERROR:root:Exception No module named 'ibm_db_dbi' while importing
│ db2_connect
│ File "/workspace/data-cloud/Data Warehouse Migration-591/demo/terraform/DWMH_Validation_Automation/.venv/lib/python3.11/site-packages/data_validation/gcs_helper.py", line 82, in read_file
│ with open(file_path, "r") as f:
│ ^^^^^^^^^^^^^^^^^^^^
│ FileNotFoundError: [Errno 2] No such file or directory:
│ '/builder/home/.config/google-pso-data-validator/REDSHIFT_CONN_CTD.connection.json'
│ ERROR:root:Exception No module named 'ibm_db_dbi' while importing
│ db2_connect
│ File "/workspace/data-cloud/Data Warehouse Migration-591/demo/terraform/DWMH_Validation_Automation/.venv/lib/python3.11/site-packages/data_validation/gcs_helper.py", line 82, in read_file
│ with open(file_path, "r") as f:
│ ^^^^^^^^^^^^^^^^^^^^
│ FileNotFoundError: [Errno 2] No such file or directory:
│ '/builder/home/.config/google-pso-data-validator/REDSHIFT_CONN_CTD.connection.json'
```
Contributor guide
Assessment
This issue has not been assessed yet.