airbytehq / airbytehq/PyAirbyte
Running multiple copies of PyAirbyte for the same stream will lead to errors
Open
- Dominant language
- Python
- Stars
- 344
- Forks
- 77
- Avg merge
- 1d 11h
- Merged PRs (30d)
- 35
Description
PyAirbyte should be able to be run multiple times simultaneously _except_ for these conditions:
1. Loading the same stream at the same time with two PyAirbyte instances is not supported. We do not block against this happening, but it will lead to race conditions, which could cause failures and/or data corruption.
2. DuckDB and/or MotherDuck may have their own limitations around concurrent writes.
Contributor guide
Assessment
This issue has not been assessed yet.