apache / apache/beam

Kafka Streams runner: TestStream

Open
#39,632 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

The Kafka Streams runner does not support `TestStream`, so tests that drive watermark and processing time explicitly cannot run against it. The `UsesTestStream` category is excluded from the ValidatesRunner suite.

The Flink runner has a portable TestStream implementation that could likely be generalised.

Part of #18479.

Contributor guide

Open the contributing guide

Research direction

Start by comparing the Kafka Streams runner with the Flink runner’s portable TestStream implementation, then inspect how the UsesTestStream category is excluded from the ValidatesRunner suite. Done means Kafka Streams tests can drive watermark and processing time through TestStream and the category is enabled successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, kafka
Domain
stream-processing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.