Postgres -> Snowflake silent failure with manual schema change approval
- Lenguaje dominante
- Python
- Estrellas
- 22.1k
- Forks
- 5.3k
- Métricas de merge de PR
- Métricas de PR pendientes
Descripción
### Connector Name
source-postgres
### Connector Version
v3.8.0-rc.11
### What step the error happened?
During the sync
### Relevant information
All of our Snowflake destination conections have been set to `Approve all changes myself` for the past few years. The behavior we have come to expect is:
- if a postgres column is added, the existing columns in the stream still sync
- if a postgres column is deleted, the remaining columns in the stream still sync
- all changes are applied when I manually update the schema
However, as of last week we started to have scheduled Airbyte runs have streams with changes silently fail when columns were removed. These were not breaking changes by Airbytes definitions. This meant that we did not receive any emails and assumed all systems were live; however our downstream users were missing data for almost a week.
### Relevant log output
```shell
2026-05-26 15:14:46 replication-orchestrator INFO Failures: [ {
"failureOrigin" : "source",
"failureType" : "config_error",
"externalMessage" : "Field 'invoice_line_configurations' not found in stream 'public.financial_administrations'. To continue syncing this stream, restore access to the field or refresh the source schema to remove it.",
"metadata" : {
"attemptNumber" : 0,
"jobId" : 86355912,
"from_trace_message" : true,
"connector_command" : "read"
},
"timestamp" : 1779797207360,
"streamDescriptor" : {
"namespace" : "public",
"name" : "financial_administrations"
}
}, {
"failureOrigin" : "source",
"failureType" : "config_error",
"externalMessage" : "Field 'materialized_configuration' not found in stream 'public.invoice_records'. To continue syncing this stream, restore access to the field or refresh the source schema to remove it.",
"metadata" : {
"attemptNumber" : 0,
"jobId" : 86355912,
"from_trace_message" : true,
"connector_command" : "read"
},
"timestamp" : 1779797207633,
"streamDescriptor" : {
"namespace" : "public",
"name" : "invoice_records"
}
}, {
"failureOrigin" : "source",
"failureType" : "config_error",
"externalMessage" : "Field 'invoice_line_configurations' not found in stream 'public.organization_invoice_groups'. To continue syncing this stream, restore access to the field or refresh the source schema to remove it.",
"metadata" : {
"attemptNumber" : 0,
"jobId" : 86355912,
"from_trace_message" : true,
"connector_command" : "read"
},
"timestamp" : 1779797208972,
"streamDescriptor" : {
"namespace" : "public",
"name" : "organization_invoice_groups"
}
} ]
```
### Contribute
- [ ] Yes, I want to contribute
Guía de contribución
Evaluación
Este issue todavía no se ha evaluado.