alibaba / alibaba/x-deeplearning

xdl.DataIO 出core

Open
#308 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
PureBasic
Stars
4.3k
Forks
1k
PR merge metrics
No merged PRs in 30d

Description

TDM按照wiki训练时, 运行train.py报错,调用xdl出core

data_io = xdl.DataIO("tdm", file_type=file_type, fs_type=xdl.fs.hdfs,
namenode="hdfs://xxxxx:9000", enable_state=False)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the train.py invocation and the xdl.DataIO configuration shown in the report, focusing on the TDM and HDFS settings. Reproduce the core dump and collect the missing traceback or crash details; the issue is done when the cause is identified and the training command no longer crashes.

Written by the indexing model from the issue text.

Assessment

Tech stack
hadoop
Domain
data-engineering, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.