Aiven-Open / Aiven-Open/bigquery-connector-for-apache-kafka
Split connector code into streaming and batch
未關閉
enhancement
- 主要語言
- Java
- 星號
- 37
- 分支
- 45
- 平均合併
- 19 小時 50 分鐘
- 30 天內合併 PR
- 5
描述
The current codebase is overloaded with conditionals, interconnected or ignored properties and doesn't take into account different limits of [BigQuery API](https://cloud.google.com/bigquery/quotas#load_jobs). That makes it harder to support and may lead to unobvious configuration problems.
The proposal is to split the current monolithic sink connector into separate artifacts, one for streaming via Storage Write API, another through GCS load jobs. It would make the code much easier to understand and support.
貢獻指南
這個儲存庫沒有索引到貢獻指南
評估
這個 Issue 還沒有評估資料。