scylladb / scylladb/scylla-cdc-java

Modernise replicator to use new APIs

Open
#41 0 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

replicator
Dominant language
Java
Stars
32
Forks
23
Avg merge
2d 6h
Merged PRs (30d)
3

Description

In this commit: https://github.com/scylladb/scylla-cdc-java/commit/77abc2358678809d08b3084aafc57d49cd6559df, getUnsafeBytes was introduced back. This API could make the replicator source code easier, eliminating the need to translate between different representations.

Additionally, the replicator now manually groups delta rows with pre/post-image. When a new API is introduced that performs this pairing automatically, the replicator should be switched to use this API.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Read commit 77abc2358678809d08b3084aafc57d49cd6559df and inspect the replicator source code to identify the representation translations and manual grouping of delta rows with pre/post-image. Confirm that the referenced APIs support both changes, then migrate the replicator and verify that its output remains equivalent.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.