apache / apache/pulsar

[Bug] Kafka Connect adapter overrides converter schema registry configuration

Open
#23,268 0 comments 0 reactions 0 assignees View on GitHub
type/bug
Dominant language
Java
Stars
15.3k
Forks
3.8k
Avg merge
1d 14h
Merged PRs (30d)
160

Description

### Search before asking

- [X] I searched in the [issues](https://github.com/apache/pulsar/issues) and found nothing similar.

### Read release policy

- [X] I understand that unsupported versions don't get bug fixes. I will attempt to reproduce the issue on a supported version of Pulsar client and Pulsar broker.

### Version

Linux, Java 17, main

### Minimal reproduce step

Configure a Kafka Connect based IO connector like Debezium and try use it with a Kafka schema registry.
It will appear to work at first because it will write to the mock registry but on restart of the source will fail to read from offsets topic because lookup from schema registry will fail (as mock registry will now be empty).

### What did you expect to see?

That Kafka Connect adapter would transparently pass through properties for schema registry so that url, auth etc can be configured correctly.

### What did you see instead?

`value.converter.schema.registry.url` is forcibly overrriden to `"mock"` making it impossible to use schema registry with Kafka Connect adapter based sources

### Anything else?

_No response_

### Are you willing to submit a PR?

- [X] I'm willing to submit a PR!

Contributor guide

Open the contributing guide

Research direction

Locate the Kafka Connect adapter entry point and trace how value.converter.schema.registry.url and related authentication properties are handled for a Debezium source. Reproduce the mock-registry behavior, then verify that configured schema-registry settings survive a source restart and allow offsets to be read successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, kafka
Domain
backend, stream-processing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.