airbytehq / airbytehq/airbyte

🐛 Airbyte Core: Large schema fetching failure

Abierto
#4,564 42 comentarios 4 reacciones 1 asignado Asignado a @bgroff Ver en GitHub
area/platform connectors/destination/local-csv connectors/destinations-files frozen team/platform-compose-discarded team/platform-hold team/platform-move type/bug
Lenguaje dominante
Python
Estrellas
22.1k
Forks
5.3k
Métricas de merge de PR
Métricas de PR pendientes

Descripción

## Enviroment
- **Airbyte version**: 0.26.4-alpha
- **OS Version / Instance**: macOS 11.2.3
- **Deployment**: Docker
- **Source Connector and version**: Salesforce 0.2.3
- **Destination Connector and version**: Local CSV 0.2.7, BigQuery 0.3.7
- **Severity**: High
- **Step where error happened**: Setup new connection

## Current Behavior
When fetching the large schema from the source, it fails with the next error I found in doker-compose up logs output:
It has nothing to do with the source itself. I used this just to catch this issue

```
org.glassfish.jersey.server.ServerRuntime$Responder writeResponse
SEVERE: An I/O error has occurred while writing a response message entity to the container output stream.
```

It runs unlit the end of the daily request quota. Then schema fetching fails due to limits.

## Expected Behavior
The size of the schema shouldn't affect the UI work.

## Logs
[error_log.txt](https://github.com/airbytehq/airbyte/files/6768958/error_log.txt)

## Steps to Reproduce
1. docker compose up airbyte project
2. create source Salesforce
3. create local CSV or BigQuery destination
4. set up a connection
5. see the error in docker compose up command output

I also tried to do this with filtered out streams and it worked well.

## Are you willing to submit a PR?
No

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.