airbytehq / airbytehq/PyAirbyte

Running multiple copies of PyAirbyte for the same stream will lead to errors

Open
#311 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
344
Forks
77
Avg merge
1d 11h
Merged PRs (30d)
35

Description

PyAirbyte should be able to be run multiple times simultaneously _except_ for these conditions:

1. Loading the same stream at the same time with two PyAirbyte instances is not supported. We do not block against this happening, but it will lead to race conditions, which could cause failures and/or data corruption.
2. DuckDB and/or MotherDuck may have their own limitations around concurrent writes.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.