alibaba / alibaba/x-deeplearning

Crossmedia的图像索引找不到是否有默认值代替

Open
#168 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
PureBasic
Stars
4.3k
Forks
1k
PR merge metrics
No merged PRs in 30d

Description

按照crossmedia准备好了图像数据放置在hdfs上,准备好了样本数据也放在hdfs上,但是拿ids去索引图像的feature时报错如下:
Check Status [PS2XDL::ConvertStatus(data_source_->BatchGet(inputx, &data_closures))] at [/home/yue.song/x-deeplearning/xdl/xdl/core/ops/ps_ops/model_server/hdfs_data_source.cc]Compute@78
Check Status [PS2XDL::ConvertStatus(st)] at [/home/yue.song/x-deeplearning/xdl/xdl/core/ops/ps_ops/model_server/model_server_client_forward.cc]operator()@44]
想问大神们,图像索引不到这个问题有没有遇到过,这个应该是很正常的现象,xdl里面有没有给找不到索引数据的id赋默认值的接口,或者有其他解决方案?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the failing BatchGet path in xdl/core/ops/ps_ops/model_server/hdfs_data_source.cc and the caller in xdl/core/ops/ps_ops/model_server/model_server_client_forward.cc. Reproduce the missing-image-feature lookup using the HDFS data described in the issue, then determine the supported behavior for IDs without indexed data; done means the failure has a defined fallback or a documented alternative and the reproduction is covered by a test.

Written by the indexing model from the issue text.

Assessment

Domain
data, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.