GoogleCloudPlatform / GoogleCloudPlatform/professional-services-data-validator
Time fields not fully supported.
- Dominant language
- Python
- Stars
- 524
- Forks
- 171
- Avg merge
- 5d 15h
- Merged PRs (30d)
- 4
Description
TIME is a temporal data type per the ANSI SQL standard.
DVT support for the TIME data type is limited as noted below:
For all backends, where TIME data type is supported, only Row Validation and Column Validation with Count aggregation are supported. Other Column aggregations - Sum, Min, Max are not supported for the TIME data type, but supported for other Temporal data types.
- BigQuery - TIME data type is supported, part of the test suite - table `pso_data_validator.dvt_time_table`
- Hive - Time data type not supported by Hive
- MySQL - Time data type works, not part of the test suite - table `pso_data_validator.dvt_time_table`
- Oracle - Time data type not supported by Oracle
- Postgres - Time without time zone data type works with DVT, not part of test suite - table `pso_data_validator.dvt_time_table`
- Postgres - Time with data type - does not work for row validation because time zone adjustment is not made by DVT - try `data-validation validate --dry-run row -sc postgres -tc bq -tbls pso_data_validator.dvt_timetz_table=pso_data_validator.dvt_time_table --primary-keys id --hash 'col_time'`
- Snowflake - not tested
- Spanner - not tested
- MS SQL Server - Time with data type - does not work for row validation because time zone adjustment is not made by DVT - try `data-validation validate --dry-run row -sc sqlserver -tc bq -tbls=pso_data_validator.dvt_time_table -pk=id -hash=col_time`
- Teradata - TIME data type is supported, part of the test suite - table `udf.dvt_time_table`
Sundar Mudupalli
Contributor guide
Assessment
This issue has not been assessed yet.