Datax从Mongo同步数据到Hive数据错行
Open
- Dominant language
- Java
- Stars
- 17.4k
- Forks
- 5.7k
- PR merge metrics
- No merged PRs in 30d
Description
数据中存在 \n 等特殊字符时，写入hdfs数据会换行。由于hive、impala等默认是换行符分割数据，所以会导致这部分错乱，请问datax中是否有对应的参数处理呢？
Contributor guide
No contributing guide indexed for this repository
Research direction
No file, test, or entry point is named. Start by tracing the Mongo-to-HDFS serialization path and checking how newline characters are handled in the DataX configuration. Done means confirming whether an existing parameter can preserve row boundaries, or defining and testing the required behavior if it cannot.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, mongodb
- Domain
- data-engineering, databases
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100