airbytehq / airbytehq/airbyte

Support True Multicast: Single Source to Multiple Destinations in a Single Connection

未關閉
#18,129 2 則留言 0 個 reaction 已指派 1 人 已被 @andyjih 認領 在 GitHub 檢視
area/platform community frozen priority/medium team/platform-move type/enhancement
主要語言
Python
星號
22.1k
分支
5.4k
平均合併
5 小時
30 天內合併 PR
671

描述

## Tell us about the problem you're trying to solve
Currently, if I need to sync the same data from a source to multiple destinations, I have to define multiple Connections. For example, I might need to sync Salesforce data to BigQuery for analysis and Postgres for application access. I can reuse the Source configuration but each Connection entails a separate request to the Source API for the same data. This results in higher load on my Airbyte cluster and an unnecessary depletion of my API quota leading to higher costs.

## Describe the solution you’d like
The Airbyte protocol already supports the standard exchange of information between a Source and Destination and Sources and Destinations are run independent of one another. Provide the ability to specify multiple destinations for a single Connection and run them with a single Source instance that passes the same data to both (or N) Destinations.

## Describe the alternative you’ve considered or used
Create a separate Connection for every Source/Destination combination.

## Additional context
N/A

## Are you willing to submit a PR?
Don't think I can.

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。