alibaba / alibaba/DataX

windows环境下hdfswriter失效

Open
#103 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

hdfswriter在win环境下由于目录分隔符问题,在hdfs上新建的临时目录会变为win下的\,即由目录变为文件,导致无法正常工作

Contributor guide

No contributing guide indexed for this repository

Research direction

Start at the HDFSWriter implementation and trace how temporary directory paths are constructed for Windows and HDFS. Reproduce the issue on Windows, then verify that the temporary path is created as a directory on HDFS rather than as a file.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, distributed-systems
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.