airbytehq / airbytehq/airbyte

[platform] Define Airbyte's Minimum Resource Requirements

Đang mở
#3,239 3 bình luận 19 reaction 0 người được giao Xem trên GitHub
frozen team/platform-move type/enhancement
Ngôn ngữ chính
Python
Star
22.1k
Fork
5.3k
Chỉ số merge pull request
Chỉ số pull request đang chờ

Mô tả

## Tell us about the problem you're trying to solve
We often get questions about minimum resource requirements to run Airbyte. Unfortunately we don't have this today, and our guideline to users are much more anecdotal. This can be frustrating for users and sucks up support time as DRI cannot easily rule out errors due to incorrect resource sizing. When running into errors, DRI can at best guesstimate from personal experience.

## Describe the solution you’d like
* Have minimum resource requirements of CPU, RAM and Disk when replicating a database of size Y GB that users can use as a guideline when testing/running Airbyte.
* Our destination set is small enough that we can reasonably have scaling recommendations for all destinations.
* Bonus: Provide guidelines of how to think about scaling.
* Brainstorming: this will probably involve setting up an automated system to test this at scale. The initial setup will let understand our current resource usage. The tests will let us know these requirements are being adhered to.

┆Issue is synchronized with this [Asana task](https://app.asana.com/0/1200367912513076/1200368229700979) by [Unito](https://www.unito.io)

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.