confluentinc / confluentinc/kafka-tutorials

New Tutorial: reorder records based on timestamp

Open
#1,022 0 comments 0 reactions 0 assignees View on GitHub
kstreams use case
Dominant language
Java
Stars
39
Forks
91
PR merge metrics
No merged PRs in 30d

Description

Issue described in ksqlDB : https://github.com/confluentinc/ksql/issues/8440

Solutions described in Kafka streams : https://github.com/confluentinc/kafka-streams-examples/pull/411

This GitHub issue is to track adding the KStreams solutions as a Kafka Tutorial

Additional notes:

you simply will have to decide how long to “wait” until you assume you’ve received “all” the messages within a given window, at which point you order them as desired. But there will always be the risk that if you wanted just one second longer - a message may arrive that was supposed to be processed first.

The only way to really fix this - is to fix it all the way up the chain to the source, so that all messages of a given key flow along the same path, and rely on TCP’s reordering.

if order is mission critical, then you either fix it all as above, or you wait so long that you know you’ve got all relevant messages…

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.