airbytehq / airbytehq/PyAirbyte

Support for Prefect 3

未關閉
#365 7 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
主要語言
Python
星號
344
分支
77
平均合併
1 天 11 小時
30 天內合併 PR
35

描述

### Topic

Make Airbyte compatible with Prefect 3

### Relevant information

Since we are blocked by [parallelism support](https://github.com/airbytehq/airbyte/issues/7750) we are running Prefect + Pyairbyte and want to upgrade to Prefect 3 but are blocked on the dependency of airbyte-cdk (which is a dependency of pyairbyte) on jsonschema = "~3.2.0" and pendulum = "<3.0.0".
[Prefect 3](https://docs.prefect.io/3.0/resources/whats-new-prefect-3) brings a lot of performance improvements to utilise pyairbyte to the fullest.
Moreover,
1. jsonschema 4.0.0 was released on Sep 30, 2021 and not upgrading does not make sense.
2. pendulum 3.0.0 brings lots of performance improvement with extensions rewritten in Rust

Upgrading these core dependencies ensures compatibility across various other integrations with airbyte.

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。