dmlc / dmlc/dgl

[GraphBolt][CUDA] `cpu-cuda` optimization

Open
#7,005 3 comments 0 reactions 0 assignees View on GitHub
Work Item
Dominant language
Python
Stars
14.3k
Forks
3.1k
PR merge metrics
No merged PRs in 30d

Description

## 🔨Work Item

**IMPORTANT:**
* This template is only for dev team to track project progress. For feature request or bug report, please use the corresponding issue templates.
* DO NOT create a new work item if the purpose is to fix an existing issue or feature request. We will directly use the issue in the project tracker.

Project tracker: https://github.com/orgs/dmlc/projects/2

## Description

We should consider moving the `copy_to` operation before the feature fetch stage so that the overlap optimization is enabled for the `cpu-cuda` mode as well. However, the features need to be pinned for this to work. On my machine, I got a 2.2x speedup by doing so.

```python
if args.storage_device == "cpu":
datapipe = datapipe.copy_to(device=device, extra_attrs=["input_nodes"])
```

@Rhett-Ying @frozenbugs

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.