alibaba / alibaba/DataX

能否支持多个异构数据库的数据融合

Open
#615 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

需求是这样的,就是两个不同类型的源数据库,一个是mysql,一个是mongdb,现在就是要分别读取这两个数据库的数据,然后通过某几个字段进行join,然后将join后的数据输出到另外一个mysql数据库。

另外还有一个需求就是把多个数据库某几张表的数据融合成宽表后,重新进行拆分,然后把拆分后的几个结果表分别同步到其对应的目标数据库。

请问现在datax能做到这种功能吗?应该属于数据抽取、数据丰富、数据拆分映射、数据转化等这面的功能。而不仅仅是简单的几个异构数据库间的数据同步。

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files, tests, or entry points. First establish whether the requested cross-database joins, wide-table transformation, splitting, and multiple destination synchronizations are existing DataX capabilities; done means documenting the supported workflow or clearly identifying the missing feature scope.

Written by the indexing model from the issue text.

Assessment

Tech stack
mongodb, mysql
Domain
data-engineering, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.