microsoft / microsoft/Graphormer

About the results on ogbp-pcba in the process of finetune

Open
#97 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
2.5k
Forks
374
PR merge metrics
No merged PRs in 30d

Description

Hi, thanks for your exciting Graphormer. I have a question when I use Graphormer v2 to pretrain on PCQM4Mv2 and finetune on ogbp-pcba or hiv. The evaluated metric ap on pcba in finetune is that '2022-03-13 12:44:53 | INFO | main | ap: 0.02584909547397629'. However, the results of leaderboard is about 0.3. The other condition is that the AUC on hiv in finetune is about 0.3(' | INFO | main | auc: 0.32)' while it is 0.8 on OGB. Thus, I want to know the reason. Maybe the hyper-parameter is not matched or the max-epoch is too small? Thank you very much.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue concerns Graphormer v2 pretraining on PCQM4Mv2 and finetuning on ogbp-pcba and hiv. Start by reproducing the reported AP and AUC logs, then compare the finetuning hyperparameters and max-epoch setting with the OGB leaderboard setup. Done means identifying and documenting the reason for the metric discrepancy.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.