alibaba / alibaba/DataX

maxcompute 和 hive 之间同步,有复杂数据类型方案

Open
#1,985 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

https://github.com/melin/datatunnel

```
DATATUNNEL SOURCE("maxcompute") OPTIONS (
projectName = "datac_test2",
tableName = "my_table_struct",
accessKeyId = 'xxx',
secretAccessKey = 'xxxxx',
endpoint='http://service.cn-hangzhou.maxcompute.aliyun.com/api',
columns = ["*"]
)
SINK("hive") OPTIONS (
databaseName = "default",
tableName = 'my_table_struct',
writeMode = 'overwrite',
columns = ["*"]
)
```

![img_v3_0251_e5466735-4d63-43d2-b64a-9a22e6b7f5ag](https://github.com/alibaba/DataX/assets/1145830/499f07bb-86a1-4985-9a8b-ab787829c090)

Contributor guide

No contributing guide indexed for this repository

Research direction

Review the linked datatunnel project and the MaxCompute-to-Hive source and sink configuration shown in the issue. Determine how the complex data types in the example should be handled; done means a documented or implemented synchronization approach that covers this configuration.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.