alibaba / alibaba/DataX

hdfsWriter写数据变多

Open
#1,778 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

使用hdfsWriter时,如果原数据存在无用空格或者换行时,写入的数据就会变乱和分行,造成写的数据变多

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue identifies hdfsWriter and input containing unnecessary spaces or newlines, but names no files or tests. Start by reproducing the behavior with such input and trace how hdfsWriter handles the records. Done means the written data no longer becomes split or unexpectedly increases.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.