Aiven-Open / Aiven-Open/bigquery-connector-for-apache-kafka

Split connector code into streaming and batch

未關閉
#73 3 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
enhancement
主要語言
Java
星號
37
分支
45
平均合併
19 小時 50 分鐘
30 天內合併 PR
5

描述

The current codebase is overloaded with conditionals, interconnected or ignored properties and doesn't take into account different limits of [BigQuery API](https://cloud.google.com/bigquery/quotas#load_jobs). That makes it harder to support and may lead to unobvious configuration problems.

The proposal is to split the current monolithic sink connector into separate artifacts, one for streaming via Storage Write API, another through GCS load jobs. It would make the code much easier to understand and support.

貢獻指南

這個儲存庫沒有索引到貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。