DataX从TXT文件读取数据写入HDFS出现因为写日志卡死
Open
- Dominant language
- Java
- Stars
- 17.4k
- Forks
- 5.7k
- PR merge metrics
- No merged PRs in 30d
Description
通过datax将txt文件数据写入hdfs时，出现一个线程一直在写日志，导致写数据线程因为无法写日志被阻塞的情况，不知道为什么会一直在写日志？
[堆栈信息.txt](https://github.com/alibaba/DataX/files/4516812/default.txt)
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the attached stack trace, then trace the TXT-to-HDFS execution and logging path in DataX. Reproduce the blocked write if possible and identify the logging condition that keeps the thread active; done means the cause is confirmed and a focused regression test or diagnostic is available.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- hadoop, java
- Domain
- data-engineering, distributed-systems
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100