airbytehq / airbytehq/airbyte

Destination: Azure Blob Storage - zero byte blob on incremental sync

未关闭
#20,902 1 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
community connectors/destination/azure-blob-storage frozen team/destinations type/bug
主要语言
Python
星标
22.1k
派生
5.3k
PR 合并指标
PR 指标待抓取

描述

## Environment
- **Airbyte version**: 0.40.23
- **OS Version / Instance**: Ubuntu
- **Deployment**: Docker
- **Source Connector and version**: Oracle DB 0.3.21
- **Destination Connector and version**: Azure Blob Storage 0.1.6
- **Step where error happened**: On incremental sync or full sync against a 0 row table

## Current Behavior
When an incremental sync happens and no new records were added on the source object since last sync, a new zero byte blob gets created. Syncing regularly and against many source objects can create enormous amounts of zero byte blobs, decreasing downstream read times.

## Expected Behavior
When an incremental sync happens and no new records were added since last sync, no new object is created.

## Logs
Log file unnecessary, behavior above describes the situation.

## Steps to Reproduce
1. Create any source
2. Create Azure Blob Storage destination
3. Set up incremental append sync
4. Successfully complete a sync
5. Make sure no new records were added in source
6. Successfully complete a sync
7. Note zero byte blobs created in destination

## Are you willing to submit a PR?
If this was a python destination, yes. It is not.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。