GoogleCloudPlatform/professional-services-data-validator

View on GitHub

Utility to compare data between homogeneous or heterogeneous environments to ensure source and target tables match

Stars: 524
Forks: 171
Open beginner issues: 0
Indexed issues: 141
Avg merge: 5d 15h
Merged PRs (30d): 4

Dominant language: Python
License: Apache-2.0
Last GitHub push: Sep 2, 2026
Latest indexed: Sep 16, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue

Open All

141 open issues indexed

Type check these modules Open

good first issue priority: p2 type: process

GoogleCloudPlatform/professional-services-data-validator#5 · 5 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026
FR: output validation results to Stackdriver Open

priority: p3

GoogleCloudPlatform/professional-services-data-validator#86 · 0 comments · 1 reaction · 1 assignee · Indexed Sep 16, 2026
Result set doesn't contain information about connections. Open

priority: p3

GoogleCloudPlatform/professional-services-data-validator#173 · 4 comments · 0 reactions · 2 assignees · Indexed Sep 16, 2026
Result of the TD queries are being saved in the pandas DF, the null is being converted to NaT Open

priority: p2

GoogleCloudPlatform/professional-services-data-validator#426 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Allow final reporting table to support upper case names Open

priority: p2

GoogleCloudPlatform/professional-services-data-validator#474 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026
Provide orchestration code to automate DVT usage Open

priority: p2

GoogleCloudPlatform/professional-services-data-validator#497 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Investigate row hash performance improvements Open

type: process

GoogleCloudPlatform/professional-services-data-validator#595 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 16, 2026
💡 Add support for SAP HANA or generic ODBC connection Open

priority: p3

GoogleCloudPlatform/professional-services-data-validator#630 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 16, 2026
Add support for ADLS Gen 2 and Azure Synapse Open

priority: p3

GoogleCloudPlatform/professional-services-data-validator#660 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Data Validator - Output Results Content Open

priority: p2

GoogleCloudPlatform/professional-services-data-validator#696 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
MySql - Spanner Comp-Field Validation failing for FLOAT datatype Open

GoogleCloudPlatform/professional-services-data-validator#719 · 4 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026
validate column: Character columns are skipped for min/max validations Open

good first issue

GoogleCloudPlatform/professional-services-data-validator#758 · 3 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026
Impersonation credentials issue - Airflow Open

GoogleCloudPlatform/professional-services-data-validator#768 · 17 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
validate row: Hash Validation Fails on Oracle Versions < 12c Open

good first issue priority: p3

GoogleCloudPlatform/professional-services-data-validator#775 · 4 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026
Support impersonation for BigQuery clients for source and target queries Open

priority: p3

GoogleCloudPlatform/professional-services-data-validator#794 · 5 comments · 13 reactions · 0 assignees · Indexed Sep 16, 2026
Dataflow Template: Support additional JDBC sources Open

dataflow template

GoogleCloudPlatform/professional-services-data-validator#848 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026
Dataflow Template: Improve load tests Open

dataflow template priority: p2

GoogleCloudPlatform/professional-services-data-validator#852 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Dataflow Template: Unit/integration tests Open

dataflow template priority: p2

GoogleCloudPlatform/professional-services-data-validator#854 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Connection type FileSystem is supported and the limitations are not documented Open

priority: p3 type: docs type: testing

GoogleCloudPlatform/professional-services-data-validator#872 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026
validate schema: Oracle NUMBER with negative scale not supported Open

priority: p3

GoogleCloudPlatform/professional-services-data-validator#898 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Add integration test suite for Redshift Open

priority: p2 type: testing

GoogleCloudPlatform/professional-services-data-validator#915 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 16, 2026
Snowflake: Support TIMESTAMP_TZ data type Open

priority: p2

GoogleCloudPlatform/professional-services-data-validator#916 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
`generate-table-partitions` generates invalid SQL in filter clause when a timestamp field is part of the primary-key Open

priority: p3

GoogleCloudPlatform/professional-services-data-validator#923 · 16 comments · 0 reactions · 2 assignees · Indexed Sep 16, 2026
schema validation: Nullable=False not identified on Hive Open

priority: p3

GoogleCloudPlatform/professional-services-data-validator#934 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
column validation: --sum of time zoned timestamp on BigQuery has side effect on other engines Open

priority: p2

GoogleCloudPlatform/professional-services-data-validator#938 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Nullable numeric/float fields can cause issues as being part of a primary key Open

priority: p2

GoogleCloudPlatform/professional-services-data-validator#951 · 4 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026
Upstream some of the custom backends here to the Ibis official repo Open

good first issue priority: p1

GoogleCloudPlatform/professional-services-data-validator#975 · 2 comments · 0 reactions · 2 assignees · Indexed Sep 16, 2026
Add extra sample date mapping to oracle sample allow list files Open

good first issue priority: p3

GoogleCloudPlatform/professional-services-data-validator#978 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026
AttributeError: 'NoneType' object has no attribute 'split' Open

priority: p2

GoogleCloudPlatform/professional-services-data-validator#987 · 6 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026
Error in Snowflake with the GEOGRAPHY type for column validation Open

priority: p2

GoogleCloudPlatform/professional-services-data-validator#1057 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 16, 2026
tests: Spanner DATE and DATETIME fail for row hash validation against BQ Open

GoogleCloudPlatform/professional-services-data-validator#1061 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Blob type Row Hash validation fails between MySQL and Spanner Open

priority: p2

GoogleCloudPlatform/professional-services-data-validator#1068 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Support Spanner PostgreSQL dialect Open

GoogleCloudPlatform/professional-services-data-validator#1073 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 16, 2026
DVT connection configurations are file based and require multiple secret manager entries to keep them secure Open

priority: p1

GoogleCloudPlatform/professional-services-data-validator#1074 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Add examples of Looker Studio dashboard for visualizing validation results Open

type: docs

GoogleCloudPlatform/professional-services-data-validator#1093 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Enable data-validation validate custom-query row with only one query file Open

priority: p2

GoogleCloudPlatform/professional-services-data-validator#1101 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Oracle DATE/BigQuery DATETIME primary key row validations fail Open

priority: p3

GoogleCloudPlatform/professional-services-data-validator#1153 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Error: Syntax error at or near "table_name" Open

type: question

GoogleCloudPlatform/professional-services-data-validator#1165 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
generate table partitions replaces whitespace in primary keys with a single space. Open

priority: p2

GoogleCloudPlatform/professional-services-data-validator#1183 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Teradata to BQ - Error "object of type 'NAType' has no len()" Open

priority: p2

GoogleCloudPlatform/professional-services-data-validator#1185 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
docs: Add Oracle documentation for when DBMS_RANDOM access has been removed from PUBLIC Open

good first issue priority: p3 type: docs

GoogleCloudPlatform/professional-services-data-validator#1207 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026
data quality check against only one (real) database connector? Open

type: question

GoogleCloudPlatform/professional-services-data-validator#1209 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Need standard format for INTERVAL columns in row validations Open

priority: p3

GoogleCloudPlatform/professional-services-data-validator#1214 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Time fields not fully supported. Open

priority: p2

GoogleCloudPlatform/professional-services-data-validator#1232 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Support for Teradata's CLOB data type in row validations Open

priority: p3

GoogleCloudPlatform/professional-services-data-validator#1256 · 3 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026
Row validations frequently fail with either "source/target_column_name" as "null" Open

type: question

GoogleCloudPlatform/professional-services-data-validator#1260 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Errors validating tables with special characters in identifiers Open

priority: p2

GoogleCloudPlatform/professional-services-data-validator#1271 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Feature request to suppress output header when no validations to report Open

priority: p3

GoogleCloudPlatform/professional-services-data-validator#1274 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Improve traceability of row validations when large number of partitions are validated Open

good first issue priority: p1

GoogleCloudPlatform/professional-services-data-validator#1276 · 4 comments · 3 reactions · 1 assignee · Indexed Sep 16, 2026
Error when attempting to create partitions on large Teradata tables (2B+ rows) Open

priority: p2

GoogleCloudPlatform/professional-services-data-validator#1280 · 4 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026

GoogleCloudPlatform/professional-services-data-validator

Get new issues in your inbox