dmlc / dmlc/dgl

[GraphBolt][CUDA] Implement Cooperative Minibatching from arXiv:2310.12403

Open
#7,273 1 comment 0 reactions 1 assignee Claimed by @mfbalin View on GitHub
Work Item
Dominant language
Python
Stars
14.3k
Forks
3.1k
PR merge metrics
No merged PRs in 30d

Description

Towards implementing [arXiv:2310.12403](https://arxiv.org/pdf/2310.12403.pdf).

Background on Cooperative Minibatching's history:

Aug 2022: #4337 was the first publicly available full implementation of the idea.
January 2023: the first submission of the paper was made to ICML, that version can be found here, [Cooperative Minibatching ICML submission](https://github.com/mfbalin/mfbalin.github.io/blob/main/public/papers/6621_Cooperative_Minibatching_.pdf).
March 2023: [Subsequent work](https://arxiv.org/abs/2303.13775) by @sandeep06011991 in March 2023 explored a similar but more limited version, sampling being performed on the CPU and then later splitting to the available GPUs.
June 2024, GSplit authors made an exact replica of our work when it comes to Cooperative Sampling, Feature Loading and Training on GPUs: https://arxiv.org/abs/2303.13775v2 without giving our paper any credit when we were busy submitting our work citing their work as concurrent work over multiple submission cycles on a goodwill basis. This was after discussing and deciding to cite each other as concurrent work with the first author (@sandeep06011991) of the GSplit paper 1 year ago.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.