airbytehq / airbytehq/PyAirbyte

feat: Add STATE message handling for incremental sync support in universal source

未关闭
#987 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Python
星标
344
派生
77
平均合并
1 天 11 小时
30 天内合并 PR
35

描述

## Summary

The universal source connector (`SourcePyAirbyteUniversal`) currently only forwards RECORD messages from the underlying PyAirbyte source. STATE messages are dropped, which means only full-refresh syncs are supported.

## Context

In `airbyte/cli/universal_connector/source.py`, the `read()` method filters messages to only yield RECORD types. STATE messages require per-stream format conversion between `airbyte_protocol.models` and `airbyte_cdk.models`, which adds complexity.

## Desired Behavior

- Forward STATE messages from the underlying source through the universal source connector
- Handle per-stream state format conversion between PyAirbyte's protocol models and the CDK models
- Enable incremental sync support for connectors wrapped by the universal source

## References

- Related PR: https://github.com/airbytehq/PyAirbyte/pull/982
- File: `airbyte/cli/universal_connector/source.py` (line 195)

---
[Devin session](https://app.devin.ai/sessions/02ea317be9054bcba5e48a6ed1622620)

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。