Aiven-Open / Aiven-Open/bigquery-connector-for-apache-kafka
Config enableBatchLoad does not work correctly when original topic name was mutated in SMT
- 主要語言
- Java
- 星號
- 37
- 分支
- 45
- 平均合併
- 19 小時 50 分鐘
- 30 天內合併 PR
- 5
描述
Following [my previous PR](https://github.com/Aiven-Open/bigquery-connector-for-apache-kafka/pull/70), when `enableBatchLoad` config is set, it doesn't work correctly when the topic name was mutated in `SinkRecord`.
I will create a separate PR if I have time to work on this. If you have any thoughts on implementation (for example, should we make the same handle for `SinkRecord.originalTopic` or approach it differently), please let me know. Ref to the problematic code is [here](https://github.com/Aiven-Open/bigquery-connector-for-apache-kafka/blob/0142bdac1bddbac74188715b0a5d984b8348fb7e/kcbq-connector/src/main/java/com/wepay/kafka/connect/bigquery/BigQuerySinkTask.java#L300).
By the way, what is the use case for having `enableBatchLoad` as list? As a user, I would expect this to be a boolean value, applied to all topics handled by the connector, not a subset - that would be much more convenient.
貢獻指南
這個儲存庫沒有索引到貢獻指南
評估
這個 Issue 還沒有評估資料。