alibaba / alibaba/DataX

datax同步oracle到phoenix数据丢失

Open
#1,204 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

同步一张接近400个字段的phoenix表,发现datax显示同步成功没有异常,但是phoenix没有数据,oracle的数据不是来源于一个表,是来源于一个sql,当我手动通过时间字段拆开这个sql成几个sql的时候,发现有部分sql的数据没有同步成功phoenix没这部分数据,但是datax依然显示同步正常,目前只发现该现象存在在phoenix字段多的表里

Contributor guide

No contributing guide indexed for this repository

Research direction

The report concerns DataX synchronization from an Oracle SQL query into a wide Phoenix table, but names no source files, tests, or entry points. Start by reproducing the missing-row case with a split time-based query and compare DataX's success result with the Phoenix row count. Done means the affected rows are transferred or the failure is reported instead of being marked successful.

Written by the indexing model from the issue text.

Assessment

Tech stack
sql
Domain
data-engineering, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.