alibaba / alibaba/DataX

hive写入如果是Windows环境很危险,会删掉上层结构

Open
#724 9 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

start rename file [hdfs://worker1:8020/user/hive/warehouse/mytest.db/test1__52277896_738f_453d_af16_171b2928b259\test__b4634892_0409_44d6_896d_766ad933c3b0]
INFO HdfsWriter$Job - start delete tmp dir [hdfs://worker1:8020/user/hive/warehouse/mytest.db]
注意到了吗?如果是Windows环境,最后是反斜杠,然后删除的就是hive库的所有表数据了

Contributor guide

No contributing guide indexed for this repository

Research direction

The report points to HdfsWriter$Job and shows a Windows path ending in a backslash, followed by deletion of the Hive warehouse directory. Start by tracing that rename/delete flow and reproduce the Windows-path case; done means the temporary path is deleted without removing the parent database or table data.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.