dmlc / dmlc/dgl

New datasets for evaluating GNNs under heterophily

Open
#5,671 0 comments 0 reactions 0 assignees View on GitHub
Work Item
Dominant language
Python
Stars
14.3k
Forks
3.1k
PR merge metrics
No merged PRs in 30d

Description

## 🔨Work Item

As requested in #5383, [A critical look at evaluation of GNNs under heterophily: Are we really making progress?](https://openreview.net/pdf?id=tJbbQfw-5wv) points out serious flaws in the widely used datasets and proposes the following new datasets.

- [ ] roman-empire
- [ ] amazon-ratings
- [ ] minesweeper
- [ ] tolokers
- [ ] questions

## Description

## Depending work items or issues

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.