confluentinc / confluentinc/schema-registry

ProtobufConverter fromConnectData doesn't honour existing field ids in SR

Open
#2,007 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
2.5k
Forks
1.2k
Avg merge
23h 27m
Merged PRs (30d)
65

Description

When source is Avro and destination is Proto if a new field is added in the avro schema at the top or somewhere in the middle, and the connector is restarted, then field ids are miss matched. This occurs because when generating the schema from the connect schema dynamically is it not taking into context the current/latest proto schema in SR and ensuring the field id is not used (typically increment from last highest).

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing ProtobufConverter.fromConnectData and how it reads the current/latest schema from Schema Registry when converting an Avro source schema to Proto. Reproduce the case where a field is inserted at the top or middle, then verify that existing field IDs remain unchanged and the new field receives an unused ID after connector restart.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.