apache / apache/druid

Kafka topicPattern fails to match topics containing dots (.) in 32.0.0

Open
#19,195 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
14.1k
Forks
3.8k
Avg merge
2d 58m
Merged PRs (30d)
233

Description

In Druid 32.0.0, when using topicPattern to ingest from Kafka topics whose names contain dots (e.g., abc.context.topic-name1), the error No partitions found for topics that match given pattern occurs. Multiple pattern formats have been tried (with/without escaping dots, regex wildcards, alternations), all failing. Directly specifying full topic names in the topic field works fine. This appears to be a bug in pattern matching for topic names with special characters

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the Druid 32.0.0 topicPattern failure with Kafka topics containing dots, then compare it with direct topic-name ingestion. Verify matching behavior across the pattern formats described in the issue; done means dotted topic names are discovered without the “No partitions found” error.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, kafka
Domain
databases, stream-processing
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
50/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.