Aiven-Open / Aiven-Open/bigquery-connector-for-apache-kafka

Config enableBatchLoad does not work correctly when original topic name was mutated in SMT

未關閉
#72 9 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
bug
主要語言
Java
星號
37
分支
45
平均合併
19 小時 50 分鐘
30 天內合併 PR
5

描述

Following [my previous PR](https://github.com/Aiven-Open/bigquery-connector-for-apache-kafka/pull/70), when `enableBatchLoad` config is set, it doesn't work correctly when the topic name was mutated in `SinkRecord`.

I will create a separate PR if I have time to work on this. If you have any thoughts on implementation (for example, should we make the same handle for `SinkRecord.originalTopic` or approach it differently), please let me know. Ref to the problematic code is [here](https://github.com/Aiven-Open/bigquery-connector-for-apache-kafka/blob/0142bdac1bddbac74188715b0a5d984b8348fb7e/kcbq-connector/src/main/java/com/wepay/kafka/connect/bigquery/BigQuerySinkTask.java#L300).

By the way, what is the use case for having `enableBatchLoad` as list? As a user, I would expect this to be a boolean value, applied to all topics handled by the connector, not a subset - that would be much more convenient.

貢獻指南

這個儲存庫沒有索引到貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。