GoogleCloudPlatform / GoogleCloudPlatform/professional-services-data-validator

Error: Syntax error at or near "table_name"

Open
#1,165 2 comments 0 reactions 0 assignees View on GitHub
type: question
Dominant language
Python
Stars
524
Forks
171
Avg merge
5d 15h
Merged PRs (30d)
4

Description

Hi 👋🏻

I'm running DVT from CLI on PostreSQL (v13.10) deployed on 2 GCP instances under private IPs with SSL enabled with config file like:

```
result_handler:
project_id: my_project_id
table_id: pso_data_validator.results
type: BigQuery
source: source_conn
target: target_conn
validations:
- aggregates:
- field_alias: count
source_column: null
target_column: null
type: count
filter_status: null
filters: []
format: table
labels: []
random_row_batch_size: null
schema_name: public
table_name: my_table_41
target_schema_name: public
target_table_name: my_table_41
threshold: 0.0
type: Column
use_random_rows: false
...
```

I've successfully runner the tool for all tables except this one that I get this stacktrace (with --verbose and -ll DEBUG)

```

06/10/2024 12:23:23 PM-INFO: Currently running the validation for YAML file: dvt_parallel/generated_validations_chunk_207.yaml
06/10/2024 12:23:27 PM-DEBUG: Checking None for explicit credentials as part of auth process...
06/10/2024 12:23:27 PM-DEBUG: Checking Cloud SDK credentials as part of auth process...
/Users/gabrielecalarota/.pyenv/versions/3.11.5/lib/python3.11/site-packages/ibis/backends/base/sql/alchemy/__init__.py:422: SAWarning: Can't validate argument 'dialect_options'; can't locate any SQLAlchemy dialect named 'dialect'
table = sa.Table(
/Users/gabrielecalarota/.pyenv/versions/3.11.5/lib/python3.11/site-packages/ibis/backends/base/sql/alchemy/__init__.py:442: SAWarning: Omitting index key for (user_id, submitted_at, task_id), key covers omitted columns.
self.inspector.reflect_table(table, table.columns)
/Users/gabrielecalarota/.pyenv/versions/3.11.5/lib/python3.11/site-packages/ibis/backends/base/sql/alchemy/__init__.py:442: SAWarning: Can't validate argument 'dialect_options'; can't locate any SQLAlchemy dialect named 'dialect'
self.inspector.reflect_table(table, table.columns)
06/10/2024 12:23:34 PM-ERROR: Error (psycopg2.errors.SyntaxError) syntax error at or near "tasks_20"
LINE 1: ...EMPORARY VIEW "11f7f2473f694bc8880251be1a50d21e" AS tasks_20
^

[SQL: CREATE TEMPORARY VIEW "11f7f2473f694bc8880251be1a50d21e" AS tasks_20]
(Background on this error at: https://sqlalche.me/e/14/f405) occurred while running config file dvt_parallel/generated_validations_chunk_207.yaml. Skipping it for now.
```

I get the same error on the same table if I try with the non-partitioned table, what can it be?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.