alibaba / alibaba/DataX

mysql(UTF-8)导出txt后,再导入HDFS编码不能为GB18030

Open
#165 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

求助mysql(UTF-8)导出txt不能转成GB18030,看来不是导出问题,是导入HDFS编码不能为GB18030

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the reported flow: export UTF-8 data from MySQL to a TXT file, then import it into HDFS while requesting GB18030 encoding. Investigate the DataX import path for where the encoding is configured or rejected. Done means the import accepts GB18030 and the resulting HDFS data has the expected encoding, with a regression test if the project provides one.

Written by the indexing model from the issue text.

Assessment

Tech stack
mysql
Domain
data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.