alibaba / alibaba/DataX

【严重】DataX读phoinex表,破坏了整个phoinex!!!

Open
#991 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

下载DataX,解压缩后无插件:hbase11xsqlreader,后下载源码,进行编译打包。
后采用如下配置:

{
"job": {
"setting": {
"speed": {
"byte":10485760
},
"errorLimit": {
"record": 0,
"percentage": 0.02
}
},
"content": [ {
"reader": {
"name": "hbase11xsqlreader",
"parameter": {
"hbaseConfig": {
"hbase.zookeeper.quorum": "yfjz-209,yfjz-194,yfjz-218:3181"
},
"table": "YMZS.TD_DI_TRACE_INOC",
"column":[]

}
},
"writer": {
"name": "streamwriter",
"parameter": {
"print":true,
"encoding": "UTF-8"
}
}
}
]
}
}

**通过脚本运行后,会一直重连,日志如下:**
INFO: Call exception, tries=11, retries=35, started=48430 ms ago, cancelled=false, msg=row 'SYSTEMCATALOG' on table 'SYSTEM:CATALOG' at region=SYSTEM:CATALOG,,1617955175422.49eb20c3e0039ffc40f8a66c7ee8b420., hostname=yfjz-194,16020,1617955150513, seqNum=2

**再用phoinex工具连,就连不上了。整个phoniex坏掉,用DataX一连搞坏了2个环境**

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the hbase11xsqlreader plugin and the supplied job configuration, then inspect the repeated SYSTEMCATALOG and SYSTEM:CATALOG connection errors in the logs. Determine whether the reported reader behavior can be reproduced against the named table and environments; done means identifying a confirmed cause and documenting a verified fix or safe failure behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
18/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.