apache / apache/hop

[Feature Request]: Read Kafka Producer topic from field

Open
#2,679 0 comments 1 reaction 0 assignees View on GitHub
awaiting triage P3 Transforms
Dominant language
Java
Stars
1.5k
Forks
476
Avg merge
18h 33m
Merged PRs (30d)
204

Description

### What would you like to happen?

migration: https://issues.apache.org/jira/browse/HOP-4147

It would be awesome to read the topic a row is sent to from a field.

This would enable more fine-grained control over the routing and probably save a lot of Kafka Producer nodes.

### Issue Priority

Priority: 3

### Issue Component

Component: Transforms

Contributor guide

Open the contributing guide

Research direction

Start by locating the Kafka Producer transform mentioned in the issue and review migration HOP-4147. Determine how the producer currently selects its topic, then verify that a row field can control routing and that the behavior reduces the need for separate Kafka Producer nodes.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, kafka
Domain
data-engineering, stream-processing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.