confluentinc / confluentinc/kafka-tutorials

Enhance Credit Card Fraud Recipe: Give example source connector

Open
#1,421 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
39
Forks
91
PR merge metrics
No merged PRs in 30d

Description

I think the credit card fraud recipe would benefit from having an example source connector. Our technical marketing demo for database modernization does this with Oracle CDC:
- https://github.com/confluentinc/demo-database-modernization/blob/master/confluent/example_oracle_cdc.json

There is a small issue when doing this -- you will get a "column name already exists" when creating the customers table because the connector will set a json record key called `id`. So you would have to rename the field and do something like this:

```sql
CREATE TABLE FD_CUSTOMERS (
customer_id DOUBLE PRIMARY KEY
) WITH (KAFKA_TOPIC = 'ORCL.ADMIN.CUSTOMERS',KEY_FORMAT='JSON',VALUE_FORMAT = 'JSON_SR');
```

All subsequent references to the field would have to be updated too.

For more information, see
- https://github.com/confluentinc/demo-database-modernization/issues/5

Contributor guide

Open the contributing guide

Research direction

Start with the linked confluent/example_oracle_cdc.json example and locate the credit card fraud recipe in this repository. Add an example source connector, account for the renamed customer_id field in the table definition and subsequent references, and verify that the recipe can create and use the customers table.

Written by the indexing model from the issue text.

Assessment

Tech stack
kafka, sql
Domain
data-engineering, stream-processing
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.