debezium / debezium/dbz

Handle Mongo collection fields not being present [DBZ-4882]

Open
#595 0 comments 0 reactions 0 assignees View on GitHub
component/mongodb-connector migrated-from-jira type/enhancement
Dominant language
HTML
Stars
6
Forks
8
Avg merge
2d 19h
Merged PRs (30d)
1

Description

Migrated from [DBZ-4882](https://issues.redhat.com/browse/DBZ-4882)

When the connector is configured to add additional fields as headers using the 

transforms.outbox.collection.fields.additional.placement it would be nice if there was an additional configuration option for configuring how to handle missing fields.

For collections Mongo does not save an entry for a field if it is null and so if the field is included in the transforms.outbox.collection.fields.additional.placement an error is thrown.

It would be nice if you could define this behaviour and just have it write null values in the the additional field instead.

Contributor guide

Open the contributing guide

Research direction

Start by locating the implementation of transforms.outbox.collection.fields.additional.placement and the Mongo collection-field handling it invokes. Trace how an absent field currently becomes an error, then identify the relevant connector tests or test entry point and verify that the chosen configuration writes a null additional field instead.

Written by the indexing model from the issue text.

Assessment

Tech stack
mongodb
Domain
database
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.