GoogleCloudPlatform / GoogleCloudPlatform/DataflowTemplates

[Bug]: The persistKafkaKey parameter is not honoured when using JSON format

Open
#2,088 5 comments 0 reactions 0 assignees View on GitHub
bug Kafka p2
Dominant language
Java
Stars
1.3k
Forks
1.1k
Avg merge
2d 20h
Merged PRs (30d)
60

Description

### Related Template(s)

kafka-to-bigquery

### Template Version

latest

### What happened?

When executing the `Kafka_to_BigQuery_Flex` template with the parameters `persistKafkaKey=true` and `messageFormat=JSON`, the `persistKafkaKey` option is not honoured. As a result, the Kafka message key is not being persisted in BigQuery table as expected.

A PR has been opened for this: #2089

### Relevant log output

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.