Distributed graph loading
Open
@maniospas is already working on this.
Since Jun 8, 2024.
feature
- Dominant language
- Python
- Stars
- 28
- Forks
- 4
- PR merge metrics
- No merged PRs in 30d
Description
Create a distributed implementation of graph loading, where each worker loads part of the same graph.
- To support interoperability between backends, create a class of
Lazygraphthat subclassesFastgraphthat replaces the whole initialization process within the preprocessor. - This might require backend-agnostic preprocessing while disabling certain customiazations of the preprocessing. Getting to execute things in a distributed backend is the trade-of.
- Create a table of graph types with advantages and disadvantages in the docs.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.