alibaba / alibaba/euler

分布式加载图数据问题

Open
#302 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
2.9k
Forks
553
PR merge metrics
No merged PRs in 30d

Description

tf_euler.initialize_graph({'mode':'remote','zk_server':'9.22.56.116:2182','zk_path':'/euler','shard_num':2,'num_retries':1})
2020-08-20 08:47:57.353119: W /Euler-OpenSource/euler/common/zk_server_monitor.cc:256] Online node: 0#9.22.56.116:20057.
2020-08-20 08:47:57.353209: W /Euler-OpenSource/euler/common/zk_server_monitor.cc:256] Online node: 1#9.22.56.102:21695.
2020-08-20 08:47:57.358419: W /Euler-OpenSource/euler/client/client_manager.h:87] shard number: 2
2020-08-20 08:47:57.358676: F /Euler-OpenSource/euler/client/client_manager.cc:33] Invalid weight meta failed, shard: 0 weight meta:
2020-08-20 08:47:57.358701: F /Euler-OpenSource/euler/client/query_proxy.cc:97] node sum weight error
2020-08-20 08:47:57.358725: F /Euler-OpenSource/euler/client/client_manager.cc:33] Invalid weight meta failed, shard: 1 weight meta:
2020-08-20 08:47:57.358743: F /Euler-OpenSource/euler/client/query_proxy.cc:97] node sum weight error
2020-08-20 08:47:57.358755: F /Euler-OpenSource/euler/client/client_manager.cc:33] Invalid weight meta failed, shard: 0 weight meta:
2020-08-20 08:47:57.358771: F /Euler-OpenSource/euler/client/query_proxy.cc:124] edge sum weight error
2020-08-20 08:47:57.358786: F /Euler-OpenSource/euler/client/client_manager.cc:33] Invalid weight meta failed, shard: 1 weight meta:
2020-08-20 08:47:57.358797: F /Euler-OpenSource/euler/client/query_proxy.cc:124] edge sum weight error
2020-08-20 08:47:57.358987: W /Euler-OpenSource/euler/client/query_proxy.cc:199] QueryProxy load successfully!
GraphMeta {
Name: graph;
Version: 2.0;
Node count:492576;
Edge count: 4813755;

Node feature info:

Edge feature info:

Node type info:
Name: 1, Index: 1;
Name: 0, Index: 0;

Edge type info:
Name: 1, Index: 1;
Name: 0, Index: 0;
}

报错:
2020-08-20 08:47:57.358676: F /Euler-OpenSource/euler/client/client_manager.cc:33] Invalid weight meta failed, shard: 0 weight meta:
2020-08-20 08:47:57.358701: F /Euler-OpenSource/euler/client/query_proxy.cc:97] node sum weight error

之后调用tf_euler.sample_node()接口会出core
![image](https://user-images.githubusercontent.com/8065137/90750346-416a8e80-e307-11ea-8f9e-9805cce55668.png)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the tf_euler.initialize_graph call with the shown remote ZooKeeper settings, then inspect client/client_manager.cc:33, client/query_proxy.cc:97 and :124, and common/zk_server_monitor.cc:256. Trace why both shards report empty weight metadata before calling tf_euler.sample_node(); done should include a clear diagnosis and prevent the subsequent core.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.