dmlc / dmlc/dgl

[Feature Request] Distributed Random Walks

Open
#2,693 5 comments 3 reactions 0 assignees View on GitHub
feature request
Dominant language
Python
Stars
14.3k
Forks
3.1k
PR merge metrics
No merged PRs in 30d

Description

## 🚀 Feature
We are asked for distributed (metapath-based) random walk support so I'm bookkeeping the issue here.

## Motivation
Large-scale network embedding for the following:
- [ ] DeepWalk
- [ ] metapath2vec
- [ ] node2vec (related issue: #2272 )
- [ ] (Optional) Causal Anonymous Walks that works great on dynamic graphs (in particular CTDG): http://snap.stanford.edu/caw/

Short random walks are also necessary for loss computation in negative sampling, e.g.
- [ ] GraphSAGE
- [ ] GATNE

## Alternatives

Use a third-party tool to sample the random walk paths first. May work for network embedding methods but not that straightforward for loss computation with random walks (like GraphSAGE or GATNE).

## Pitch

Efficient distributed random walk support for both homogeneous graph and heterogeneous graph (metapath-based in this case).

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading this issue and the related node2vec issue (#2272), then compare the listed use cases: DeepWalk, metapath2vec, GraphSAGE, and GATNE. Done means defining and implementing efficient distributed random-walk support for homogeneous and metapath-based heterogeneous graphs, including the needs of network embedding and loss computation.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
distributed-systems, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.