apache / apache/druid

Data ingestion from Flink to Druid

Open
#17,507 1 comment 0 reactions 0 assignees View on GitHub
Design Review Proposal
Dominant language
Java
Stars
14.1k
Forks
3.8k
Avg merge
2d 58m
Merged PRs (30d)
233

Description

### Motivation

We observe various applications utilizing the architecture of Flink -> Kafka -> Druid. However, in many cases, I believe that the Kafka hop may not be necessary. If a Flink connector for Druid were available, it would streamline the integration and make utilizing Druid much more straightforward

### Proposed changes

Open for discussion on implementation and code changes.

Contributor guide

Open the contributing guide

Research direction

The issue names no files, tests, or entry points. Start by clarifying the proposed Flink-to-Druid connector scope, supported integration path, and expected behavior with the maintainers. Done would require an agreed design and implementation plan before code changes can be scoped.

Written by the indexing model from the issue text.

Assessment

Tech stack
kafka
Domain
data-engineering, databases, stream-processing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.