KafkaIO should raise an error if both .withReadCommitted() and .commitOffsetsInFinalize() are used
Open
improvement
io
java
kafka
P3
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
Read committed tells KafkaIO to only read messages that are already committed which means that committing offsets in finalize is a no-op.
Users should be using one or the other and is similar to making sure that either auto commit is enabled in the reader of KafkaIO does the committing which we have error checking for already.
Imported from Jira [BEAM-13353](https://issues.apache.org/jira/browse/BEAM-13353). Original Jira may contain additional context.
Reported by: lcwik.
Contributor guide
Assessment
This issue has not been assessed yet.