airbytehq / airbytehq/terraform-provider-airbyte
Failure to delete temporary tables when Transformation Query Run Type is set to batch
- Lenguaje dominante
- Go
- Estrellas
- 67
- Forks
- 33
- Merge medio
- 2 min
- PR fusionados (30 d)
- 1
Descripción
We've created a destination using the [airbyte_destination_bigquery](https://registry.terraform.io/providers/airbytehq/airbyte/latest/docs/resources/destination_bigquery) resource. We have set the Transformation Query Run Type to batch (as shown in the screenshot below)
We've noticed that the staging files created by batch are not deleted. The query being run to delete the staging files is as follows:
> DROP TABLE IF EXISTS data-lake-dev-8dc2.airbyte_internal.jira_sprints_airbyte_raw__stream__airbyte_bigquery_connection_test_3f030d368e5249e2b06c85385bae3b92;
A fix for this is to wrap the Big Query project id in back ticks, the following query works as expected:
> DROP TABLE IF EXISTS `data-lake-dev-8dc2`.airbyte_internal.jira_sprints_airbyte_raw__stream__airbyte_bigquery_connection_test_3f030d368e5249e2b06c85385bae3b92;
Could this fix please be added in a future release?
Thank you
Guía de contribución
Evaluación
Este issue todavía no se ha evaluado.