debezium / debezium/dbz

Allow passing topic creation settings in Kafka sink

Open
#1,666 5 comments 0 reactions 1 assignee Claimed by @siddhantcvdi View on GitHub
component/debezium-server good first issue type/enhancement
Dominant language
HTML
Stars
6
Forks
8
Avg merge
2d 19h
Merged PRs (30d)
1

Description

## Feature request or enhancement

_For feature requests or enhancements, please provide the following information:_

**Which use case/requirement will be addressed by the proposed feature?**

In Kafka Connect, users can pass settings to the runtime, such as `topic.creation.*`, to define default replication factor, partitions, cleanup policy, and compression for topics; however, this is not currently possible when using the Debezium Server Kafka sink.

For parity sake, we should consider introducing the `AdminClient` to the Kafka sink, where we could create the topic with the desired creation settings before publishing, bringing the same level of topic creation control to Debezium Server that Kafka Connect offers.

---

**Implementation ideas (optional)**

[#community-operator > ✔ How to specify the topic default cleanup policy?](https://debezium.zulipchat.com/#narrow/channel/392460-community-operator/topic/.E2.9C.94.20How.20to.20specify.20the.20topic.20default.20cleanup.20policy.3F/with/577154934)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.