airbytehq / airbytehq/airbyte

Postgres -> Snowflake silent failure with manual schema change approval

Abierto
#78,427 2 comentarios 0 reacciones 0 asignados Ver en GitHub
area/connectors autoteam connectors/source/postgres needs-triage team/extensibility type/bug
Lenguaje dominante
Python
Estrellas
22.1k
Forks
5.3k
Métricas de merge de PR
Métricas de PR pendientes

Descripción

### Connector Name

source-postgres

### Connector Version

v3.8.0-rc.11

### What step the error happened?

During the sync

### Relevant information

All of our Snowflake destination conections have been set to `Approve all changes myself` for the past few years. The behavior we have come to expect is:
- if a postgres column is added, the existing columns in the stream still sync
- if a postgres column is deleted, the remaining columns in the stream still sync
- all changes are applied when I manually update the schema

However, as of last week we started to have scheduled Airbyte runs have streams with changes silently fail when columns were removed. These were not breaking changes by Airbytes definitions. This meant that we did not receive any emails and assumed all systems were live; however our downstream users were missing data for almost a week.

### Relevant log output

```shell
2026-05-26 15:14:46 replication-orchestrator INFO Failures: [ {
"failureOrigin" : "source",
"failureType" : "config_error",
"externalMessage" : "Field 'invoice_line_configurations' not found in stream 'public.financial_administrations'. To continue syncing this stream, restore access to the field or refresh the source schema to remove it.",
"metadata" : {
"attemptNumber" : 0,
"jobId" : 86355912,
"from_trace_message" : true,
"connector_command" : "read"
},
"timestamp" : 1779797207360,
"streamDescriptor" : {
"namespace" : "public",
"name" : "financial_administrations"
}
}, {
"failureOrigin" : "source",
"failureType" : "config_error",
"externalMessage" : "Field 'materialized_configuration' not found in stream 'public.invoice_records'. To continue syncing this stream, restore access to the field or refresh the source schema to remove it.",
"metadata" : {
"attemptNumber" : 0,
"jobId" : 86355912,
"from_trace_message" : true,
"connector_command" : "read"
},
"timestamp" : 1779797207633,
"streamDescriptor" : {
"namespace" : "public",
"name" : "invoice_records"
}
}, {
"failureOrigin" : "source",
"failureType" : "config_error",
"externalMessage" : "Field 'invoice_line_configurations' not found in stream 'public.organization_invoice_groups'. To continue syncing this stream, restore access to the field or refresh the source schema to remove it.",
"metadata" : {
"attemptNumber" : 0,
"jobId" : 86355912,
"from_trace_message" : true,
"connector_command" : "read"
},
"timestamp" : 1779797208972,
"streamDescriptor" : {
"namespace" : "public",
"name" : "organization_invoice_groups"
}
} ]
```

### Contribute

- [ ] Yes, I want to contribute

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.