airbytehq / airbytehq/terraform-provider-airbyte

Failure to delete temporary tables when Transformation Query Run Type is set to batch

Abierto
#191 0 comentarios 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
Go
Estrellas
67
Forks
33
Merge medio
2 min
PR fusionados (30 d)
1

Descripción

We've created a destination using the [airbyte_destination_bigquery](https://registry.terraform.io/providers/airbytehq/airbyte/latest/docs/resources/destination_bigquery) resource. We have set the Transformation Query Run Type to batch (as shown in the screenshot below)

Image

We've noticed that the staging files created by batch are not deleted. The query being run to delete the staging files is as follows:

> DROP TABLE IF EXISTS data-lake-dev-8dc2.airbyte_internal.jira_sprints_airbyte_raw__stream__airbyte_bigquery_connection_test_3f030d368e5249e2b06c85385bae3b92;

A fix for this is to wrap the Big Query project id in back ticks, the following query works as expected:

> DROP TABLE IF EXISTS `data-lake-dev-8dc2`.airbyte_internal.jira_sprints_airbyte_raw__stream__airbyte_bigquery_connection_test_3f030d368e5249e2b06c85385bae3b92;

Could this fix please be added in a future release?

Thank you

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.