alibaba / alibaba/DataX

写了个kafka读插件往mysql写没有反应,也没有报错,请大侠们指导下!!!

Open
#602 1 comment 2 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

@Override
public void startRead(RecordSender recordSender) {
........
while (flag) {
........
oneRecord = buildOneRecord(recordSender, value);
//如果返回值不等于null表示不是异常消息。
if (oneRecord != null) {
System.out.println("oneRecord::::::::::::" + oneRecord.toString());
recordSender.sendToWriter(oneRecord);
recordSender.flush();
}
}
}

打印如下:
oneRecord::::::::::::{"data":[{"byteSize":1,"rawData":"2","type":"STRING"},{"byteSize":2,"rawData":"21","type":"STRING"},{"byteSize":2,"rawData":"22","type":"STRING"},{"byteSize":2,"rawData":"23","type":"STRING"}],"size":4}

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the Kafka reader's startRead method and the buildOneRecord call shown in the issue, then trace RecordSender.sendToWriter and flush into the MySQL writer. Reproduce the reported case using the displayed record output and inspect where processing stops; done means the cause of the missing write is identified and records are demonstrably persisted or the missing diagnostic is documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, kafka, mysql
Domain
data-engineering, databases, stream-processing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.