alibaba / alibaba/DataX

Hologres Writer 不可以使用

Open
#1,450 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

![image](https://user-images.githubusercontent.com/24584131/179496251-bb24248d-9c96-4e88-a910-59cbb2121dc6.png)

Hologres Writer 不可以使用,换成postgres是ok的

配置代码

{
"job": {
"setting": {
"speed": {
"byte": 1048576
}
},
"content": [

{
"reader": {
"name": "sqlserverreader",
"parameter": {
"username": "xxx",
"password": "xxxx",
"column": [
"ID", "Uid", "MyClassID", "DCourseID", "PlayTime", "AddDate", "Fromweb", "LastPlayTime"
],
"splitPk": "ID",
"where":" ID < 160744217",
"connection": [
{
"table":[
"DZ_StudyRecord"
],
"jdbcUrl": [
"jdbc:sqlserver://wx233233um.sqlserver.rds.aliyuncs.com:1433;databaseName=doz_database"
]
}
]
}
},
"writer": {
"name": "hologresjdbcwriter",
"parameter": {
"username": "xxxx",
"password": "xxxx",
"column": [
"id","uid","myclassid","dcourseid","playtime", "adddate","fromweb","lastplaytime"
],
"session": [
"set session sql_mode='ANSI'"
],
"preSql":[
"truncate table ods.dz_studyrecord;"
],
"connection": [
{
"jdbcUrl": "jdbc:postgresql://xxxx-cn-beijing.hologres.aliyuncs.com:80/ess_bigdata_test?reWriteBatchedInserts=true",
"table": [
"ods.dz_studyrecord"
]
}
],
"writeMode" : "REPLACE",
"client" : {
"writeThreadSize" : 3
}
}
}
}
]
}
}

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names the DataX hologresjdbcwriter entry point and provides a job configuration; start by reproducing it with that configuration and compare it with the working PostgreSQL case. No error output, expected behavior, source file, or test is provided, so the fix is not yet defined; done should mean the supplied job runs successfully against Hologres.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, postgresql
Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.