dmlc / dmlc/dgl

[GraphBolt] Add more and larger `BuiltinDataset`s

Open
#6,909 8 comments 0 reactions 1 assignee Claimed by @BowenYao18 View on GitHub
Work Item
Dominant language
Python
Stars
14.3k
Forks
3.1k
PR merge metrics
No merged PRs in 30d

Description

## 🔨Work Item

**IMPORTANT:**
* This template is only for dev team to track project progress. For feature request or bug report, please use the corresponding issue templates.
* DO NOT create a new work item if the purpose is to fix an existing issue or feature request. We will directly use the issue in the project tracker.

Project tracker: https://github.com/orgs/dmlc/projects/2

## Description

Let's add more large datasets such as `ogbn-papers100M` from [Open Graph Benchmark](https://ogb.stanford.edu/docs/nodeprop/#ogbn-papers100M) and even larger [IGB-datasets](https://github.com/IllinoisGraphBenchmark/IGB-Datasets) (homogenous and hetero variants).

`ogbn-papers100M` is a better dataset than `ogbn-products` because `ogbn-products` takes less than 1 minute to train on the GPU is on a smaller scale with #6861. We should do our profiling with examples that use larger-scale datasets. Finally, the IGB datasets are much much larger scale, and training them will take much longer time, which will be a really good benchmark for us to test largest-scale training scenarios (Covers both homogenous `igb` prefix and heterogenous scenarios `igbh` prefix).

- [x] ogbn-papers100M
- [ ] igb-hom #7717, #7770
- [ ] igb-het #7708

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.