alibaba / alibaba/x-deeplearning

train.py xdl.DataIO出错

Open
#310 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
PureBasic
Stars
4.3k
Forks
1k
PR merge metrics
No merged PRs in 30d

Description

`data_io = xdl.DataIO("tdm", file_type=file_type, fs_type=xdl.fs.hdfs,
namenode="hdfs://xxx:9000/tmp/tdm/data", enable_state=False)`
![image](https://user-images.githubusercontent.com/25922905/71241670-21816600-2347-11ea-9e2c-66a9995e6fdc.png)
这段代码出错,我尝试了本地hadoop shell访问成功,但是这个接口调用出错
![image](https://user-images.githubusercontent.com/25922905/71241737-4d9ce700-2347-11ea-9782-dff7e2e370e9.png)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the DataIO call in train.py and review the attached error screenshots alongside the successful local Hadoop shell access. Compare the HDFS settings shown in the issue and determine the cause of the interface failure; done means the cause is verified and a working DataIO invocation is documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.