awslabs / awslabs/graphstorm

[Optimization-wholegraph] Remove CUDA dependency during conversion to WholeGraph format

Open
#547 2 comments 0 reactions 2 assignees Claimed by @chang-l View on GitHub
Dominant language
Python
Stars
452
Forks
76
PR merge metrics
No merged PRs in 30d

Description

Node features are transformed from DGL format to WholeGraph format using the [convert_feat_to_wholegraph.py](https://github.com/awslabs/graphstorm/tree/main/tools) script. However, this script significantly consumes memory, prompting us to explore utilizing our substantial CPU instances like `r5` or `X1`. Unfortunately, due to its reliance on WholeGraph's CUDA dependency (pylibwholegraph.binding.wholememory_binding), leveraging these instances is currently not possible. Are there alternative approaches to address this limitation?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.