Make Debezium MongoDB connector compatible with DocumentDB [DBZ-4674]
- Dominant language
- HTML
- Stars
- 6
- Forks
- 8
- Avg merge
- 2d 19h
- Merged PRs (30d)
- 1
Description
Migrated from [DBZ-4674](https://issues.redhat.com/browse/DBZ-4674)
MongoDB connector should be used for streaming from Amazon DocumentDB using change streams mode.
The problem is that query for oplog position fails - see log file.
If snapshot is disabled then the streaming still tries to get the oplog position in {{io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.initializeOffsets(MongoDbConnectorConfig, ReplicaSets)}} This should not be necessary for change streams.
Contributor guide
Research direction
Start in io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.initializeOffsets(MongoDbConnectorConfig, ReplicaSets), focusing on the oplog-position query when snapshotting is disabled. Reproduce the DocumentDB change-stream startup failure using the referenced log details if available, and verify that streaming change streams no longer require an unnecessary oplog position.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, mongodb
- Domain
- databases
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100