datax设置访问datax用户
- Dominant language
- Java
- Stars
- 17.4k
- Forks
- 5.7k
- PR merge metrics
- No merged PRs in 30d
Description
datax设置访问datax用户。
现象：一些公司对hdfs做了封装，root用户对一下文件的权限不够。
报错：com.alibaba.datax.common.exception.DataXException: Code:[HdfsWriter-04], Description:[您配置的文件在写入时出现IO异常.]. - org.apache.hadoop.security.AccessControlException: Permission denied: user=root, access=WRITE, inode="/inceptor1/user/hive/warehouse/odsdb.db/hive__fd358dbc_24db_4fa5_a121_f9455cf33659/testuser__bc6c2ace_e364_4381_84e6_72ba8920ecb3":hive:hive:drwxr-xr-x
Contributor guide
No contributing guide indexed for this repository
Research direction
Start at the HdfsWriter-04 error path and inspect how DataX selects the Hadoop user for HDFS writes. Reproduce the permission-denied case with a wrapped HDFS deployment, then define completion as allowing the configured DataX user to perform the required write without relying on root permissions.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- hadoop, java
- Domain
- data-engineering, distributed-systems
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100