GoogleCloudPlatform / GoogleCloudPlatform/professional-services-data-validator

Time fields not fully supported.

Open
#1,232 0 comments 0 reactions 0 assignees View on GitHub
priority: p2
Dominant language
Python
Stars
524
Forks
171
Avg merge
5d 15h
Merged PRs (30d)
4

Description

TIME is a temporal data type per the ANSI SQL standard.

DVT support for the TIME data type is limited as noted below:

For all backends, where TIME data type is supported, only Row Validation and Column Validation with Count aggregation are supported. Other Column aggregations - Sum, Min, Max are not supported for the TIME data type, but supported for other Temporal data types.

- BigQuery - TIME data type is supported, part of the test suite - table `pso_data_validator.dvt_time_table`
- Hive - Time data type not supported by Hive
- MySQL - Time data type works, not part of the test suite - table `pso_data_validator.dvt_time_table`
- Oracle - Time data type not supported by Oracle
- Postgres - Time without time zone data type works with DVT, not part of test suite - table `pso_data_validator.dvt_time_table`
- Postgres - Time with data type - does not work for row validation because time zone adjustment is not made by DVT - try `data-validation validate --dry-run row -sc postgres -tc bq -tbls pso_data_validator.dvt_timetz_table=pso_data_validator.dvt_time_table --primary-keys id --hash 'col_time'`
- Snowflake - not tested
- Spanner - not tested
- MS SQL Server - Time with data type - does not work for row validation because time zone adjustment is not made by DVT - try `data-validation validate --dry-run row -sc sqlserver -tc bq -tbls=pso_data_validator.dvt_time_table -pk=id -hash=col_time`
- Teradata - TIME data type is supported, part of the test suite - table `udf.dvt_time_table`

Sundar Mudupalli

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.