HDFSWriter写入失败的文件残留问题
Open
- Dominant language
- Java
- Stars
- 17.4k
- Forks
- 5.7k
- PR merge metrics
- No merged PRs in 30d
Description
HDFSWriter发生网络中断等情况造成无法与HDFS建立连接，需要手动删除已经写入的文件和临时目录。有什么方法可以对源码进行修改，使其自动删除写入失败时的残留文件。
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating the HDFSWriter implementation and tracing what happens when a network interruption prevents the HDFS connection or write from completing. Reproduce a failed write and verify that both the partially written file and temporary directory are removed automatically.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering, distributed-systems
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100