dmlc / dmlc/dgl

Investigate graphs load time cost and improve

Open
#4,636 2 comments 0 reactions 1 assignee Claimed by @peizhou001 View on GitHub
Dominant language
Python
Stars
14.3k
Forks
3.1k
PR merge metrics
No merged PRs in 30d

Description

## 🔨Work Item

**IMPORTANT:**
* This template is only for dev team to track project progress. For feature request or bug report, please use the corresponding issue templates.
* DO NOT create a new work item if the purpose is to fix an existing issue or feature request. We will directly use the issue in the project tracker.

Project tracker: https://github.com/orgs/dmlc/projects/2

## Description
DGL graphs load is quarter the speed of PYG againt different graphs, and the gap increase when repeated number of graphs increase, we should investigate why this happens and try to improve.
*DGL*
| Graph number | Size in disk(Mb) | Load time(Seconds) |
| :-----| ----: | :----: |
| 100K | 105| 42 |
| 1000K | 1047 | 422 |
| 5000K | 5235 | 2067 |

*PYG*
| Graph number | Size in disk(Mb) | Load time(Seconds) |
| :-----| ----: | :----: |
| 100K | 105| 9.72 |
| 1000K | 1057 | 95.53 |
| 5000K | 5246 | 473.26|

## Depending work items or issues

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.