Leaderboards for Graph Property Prediction

Check leaderboards for
- ogbg-molhiv
- ogbg-molpcba
- ogbg-ppa
- ogbg-code2

The bold method name indicates that the implementation is official (by the author of the original paper).
Package denotes the required package version for each dataset to be eligible for the leaderboard.


Leaderboard for ogbg-molhiv

The ROC-AUC score on the test and validation sets. The higher, the better.

Package: >=1.1.1

Rank Method Test ROC-AUC Validation ROC-AUC Contact References #Params Hardware Date
1 MorganFP+Rand. Forest 0.8060 ± 0.0010 0.8420 ± 0.0030 Cyrus Maher Paper, Code 230,000 CPU Sep 21, 2020
2 DGN 0.7970 ± 0.0097 0.8470 ± 0.0047 Saro Passaro Paper, Code 114,065 NVIDIA Tesla T4 (15GB GPU) Nov 20, 2020
3 DeeperGCN+FLAG 0.7942 ± 0.0120 0.8425 ± 0.0061 Kezhi Kong Paper, Code 531,976 NVIDIA Tesla V100 (32GB GPU) Oct 20, 2020
4 PNA 0.7905 ± 0.0132 0.8519 ± 0.0099 Gabriele Corso Paper, Code 326,081 NVIDIA Tesla T4 (15GB GPU) Nov 25, 2020
5 GCN+GraphNorm 0.7883 ± 0.0100 0.7904 ± 0.0115 Shengjie Luo Paper, Code 526,201 NVIDIA Tesla P100 (16GB GPU) Sep 16, 2020
6 HIMP 0.7880 ± 0.0082 Please tell us Matthias Fey Paper, Code 153,029 GeForce RTX 2080 (11GB GPU) Jun 22, 2020
7 DeeperGCN 0.7858 ± 0.0117 0.8427 ± 0.0063 Guohao Li - DeepGCNs.org Paper, Code 531,976 NVIDIA Tesla V100 (32GB GPU) Jun 16, 2020
8 GSN 0.7799 ± 0.0100 0.8658 ± 0.0084 Giorgos Bouritsas Paper, Code 3,338,701 NVIDIA Tesla V100-SXM2 (16GB) Jan 5, 2021
9 WEGL 0.7757 ± 0.0111 0.8101 ± 0.0097 Navid Naderializadeh Paper, Code 361,064 NVIDIA Tesla P100 (16GB GPU) Jun 26, 2020
10 GIN+virtual node+FLAG 0.7748 ± 0.0096 0.8438 ± 0.0128 Kezhi Kong Paper, Code 3,336,306 GeForce RTX 2080 Ti (11GB GPU) Oct 20, 2020
11 GIN+virtual node 0.7707 ± 0.0149 0.8479 ± 0.0068 Weihua Hu – OGB team Paper, Code 3,336,306 GeForce RTX 2080 (11GB GPU) May 1, 2020
12 GCN+FLAG 0.7683 ± 0.0102 0.8176 ± 0.0087 Kezhi Kong Paper, Code 527,701 GeForce RTX 2080 Ti (11GB GPU) Oct 20, 2020
13 GIN+FLAG 0.7654 ± 0.0114 0.8225 ± 0.0155 Kezhi Kong Paper, Code 1,885,206 GeForce RTX 2080 Ti (11GB GPU) Oct 20, 2020
14 GCN 0.7606 ± 0.0097 0.8204 ± 0.0141 Weihua Hu – OGB team Paper, Code 527,701 GeForce RTX 2080 (11GB GPU) May 1, 2020
15 GCN+virtual node 0.7599 ± 0.0119 0.8384 ± 0.0091 Weihua Hu – OGB team Paper, Code 1,978,801 GeForce RTX 2080 (11GB GPU) May 1, 2020
16 GIN 0.7558 ± 0.0140 0.8232 ± 0.0090 Weihua Hu – OGB team Paper, Code 1,885,206 GeForce RTX 2080 (11GB GPU) May 1, 2020


Leaderboard for ogbg-molpcba

The Average Precision (AP) score on the test and validation sets. The higher, the better.

Note: The evaluation metric has been changed from PRC-AUC (Aug 11, 2020).

Package: >=1.2.2

Rank Method Test AP Validation AP Contact References #Params Hardware Date
1 GINE+ w/ virtual nodes 0.2917 ± 0.0015 0.3065 ± 0.0030 Rémy Brossard Paper, Code 6,147,029 GeForce GTX 1080 Ti Dec 1, 2020
2 DeeperGCN+virtual node+FLAG 0.2842 ± 0.0043 0.2952 ± 0.0029 Kezhi Kong Paper, Code 5,550,208 NVIDIA Tesla V100 (32GB GPU) Oct 21, 2020
3 GIN+virtual node+FLAG 0.2834 ± 0.0038 0.2912 ± 0.0026 Kezhi Kong Paper, Code 3,374,533 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
4 DeeperGCN+virtual node 0.2781 ± 0.0038 0.2920 ± 0.0025 Guohao Li - DeepGCNs.org Paper, Code 5,550,208 NVIDIA Tesla V100 (32GB GPU) Aug 11, 2020
5 GIN+virtual node 0.2703 ± 0.0023 0.2798 ± 0.0025 Weihua Hu – OGB team Paper, Code 3,374,533 GeForce RTX 2080 (11GB GPU) Aug 11, 2020
6 GCN+virtual node+FLAG 0.2483 ± 0.0037 0.2556 ± 0.0040 Kezhi Kong Paper, Code 2,017,028 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
7 GCN+virtual node 0.2424 ± 0.0034 0.2495 ± 0.0042 Weihua Hu – OGB team Paper, Code 2,017,028 GeForce RTX 2080 (11GB GPU) Aug 11, 2020
8 GIN+FLAG 0.2395 ± 0.0040 0.2451 ± 0.0042 Kezhi Kong Paper, Code 1,923,433 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
9 ChebNet 0.2306 ± 0.0016 0.2372 ± 0.0018 Axel Nilsson Paper, Code 1,475,003 GeForce RTX 2070 8GB Dec 28, 2020
10 GIN 0.2266 ± 0.0028 0.2305 ± 0.0027 Weihua Hu – OGB team Paper, Code 1,923,433 GeForce RTX 2080 (11GB GPU) Aug 11, 2020
11 GCN+FLAG 0.2116 ± 0.0017 0.2150 ± 0.0022 Kezhi Kong Paper, Code 565,928 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
12 MorganFP+Rand. Forest 0.2054 ± 0.0004 0.2226 ± 0.0002 Cyrus Maher Paper, Code 29,440,000 CPU Sep 21, 2020
13 GCN 0.2020 ± 0.0024 0.2059 ± 0.0033 Weihua Hu – OGB team Paper, Code 565,928 GeForce RTX 2080 (11GB GPU) Aug 11, 2020


Leaderboard for ogbg-ppa

The multi-class classification accuracy on the test and validation sets. The higher, the better.

Package: >=1.1.1

Rank Method Test Accuracy Validation Accuracy Contact References #Params Hardware Date
1 ExpC 0.7976 ± 0.0072 0.7518 ± 0.0080 Mingqi Yang Paper, Code 1,369,397 NVIDIA Tesla V100 (32GB GPU) Dec 14, 2020
2 DeeperGCN+FLAG 0.7752 ± 0.0069 0.7484 ± 0.0052 Kezhi Kong Paper, Code 2,336,421 NVIDIA Tesla V100 (32GB GPU) Oct 21, 2020
3 DeeperGCN 0.7712 ± 0.0071 0.7313 ± 0.0078 Guohao Li - DeepGCNs.org Paper, Code 2,336,421 NVIDIA Tesla V100 (32GB GPU) Jun 16, 2020
4 GIN+virtual node+FLAG 0.7245 ± 0.0114 0.6789 ± 0.0079 Kezhi Kong Paper, Code 3,288,042 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
5 GIN+virtual node 0.7037 ± 0.0107 0.6678 ± 0.0105 Weihua Hu – OGB team Paper, Code 3,288,042 GeForce RTX 2080 (11GB GPU) May 1, 2020
6 GCN+virtual node+FLAG 0.6944 ± 0.0052 0.6638 ± 0.0055 Kezhi Kong Paper, Code 1,930,537 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
7 GIN+FLAG 0.6905 ± 0.0092 0.6465 ± 0.0070 Kezhi Kong Paper, Code 1,836,942 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
8 GIN 0.6892 ± 0.0100 0.6562 ± 0.0107 Weihua Hu – OGB team Paper, Code 1,836,942 GeForce RTX 2080 (11GB GPU) May 1, 2020
9 GCN+virtual node 0.6857 ± 0.0061 0.6511 ± 0.0048 Weihua Hu – OGB team Paper, Code 1,930,537 GeForce RTX 2080 (11GB GPU) May 1, 2020
10 GCN 0.6839 ± 0.0084 0.6497 ± 0.0034 Weihua Hu – OGB team Paper, Code 479,437 GeForce RTX 2080 (11GB GPU) May 1, 2020


Leaderboard for ogbg-code2

The F1 score on the test and validation sets. The higher, the better.

Package: >=1.2.5

Deprecated ogbg-code leaderboard can be found here.
Rank Method Test F1 score Validation F1 score Contact References #Params Hardware Date
1 GCN+virtual node 0.1595 ± 0.0018 0.1461 ± 0.0013 Weihua Hu – OGB team Paper, Code 12,484,310 GeForce RTX 2080 (11GB GPU) Feb 24, 2021
2 GIN+virtual node 0.1581 ± 0.0026 0.1439 ± 0.0020 Weihua Hu – OGB team Paper, Code 13,841,815 GeForce RTX 2080 (11GB GPU) Feb 24, 2021
3 GCN 0.1507 ± 0.0018 0.1399 ± 0.0017 Weihua Hu – OGB team Paper, Code 11,033,210 GeForce RTX 2080 (11GB GPU) Feb 24, 2021
4 GIN 0.1495 ± 0.0023 0.1376 ± 0.0016 Weihua Hu – OGB team Paper, Code 12,390,715 GeForce RTX 2080 (11GB GPU) Feb 24, 2021