Leaderboards for Graph Property Prediction

Check leaderboards for
- ogbg-molhiv
- ogbg-molpcba
- ogbg-ppa
- ogbg-code2

The bold method name indicates that the implementation is official (by the author of the original paper).
Package denotes the required package version for each dataset to be eligible for the leaderboard.


Leaderboard for ogbg-molhiv

The ROC-AUC score on the test and validation sets. The higher, the better.

Package: >=1.1.1

Rank Method Test ROC-AUC Validation ROC-AUC Contact References #Params Hardware Date
1 Neural FingerPrints 0.8232 ± 0.0047 0.8331 ± 0.0054 Shanzhuo Zhang (PaddleHelix & PGL) Paper, Code 2,425,102 Tesla V100 (32GB) Mar 15, 2021
2 MorganFP+Rand. Forest 0.8060 ± 0.0010 0.8420 ± 0.0030 Cyrus Maher Paper, Code 230,000 CPU Sep 21, 2020
3 P-WL 0.8039 ± 0.0040 0.8279 ± 0.0059 Daniel Marcos Mendoza Paper, Code 4,600,000 CPU Mar 29, 2021
4 DGN 0.7970 ± 0.0097 0.8470 ± 0.0047 Saro Passaro Paper, Code 114,065 NVIDIA Tesla T4 (15GB GPU) Nov 20, 2020
5 DeeperGCN+FLAG 0.7942 ± 0.0120 0.8425 ± 0.0061 Kezhi Kong Paper, Code 531,976 NVIDIA Tesla V100 (32GB GPU) Oct 20, 2020
6 PHC-GNN 0.7934 ± 0.0116 0.8217 ± 0.0089 Tuan Le Paper, Code 110,909 Tesla V100 (32GB) Apr 14, 2021
7 PNA 0.7905 ± 0.0132 0.8519 ± 0.0099 Gabriele Corso Paper, Code 326,081 NVIDIA Tesla T4 (15GB GPU) Nov 25, 2020
8 GCN+GraphNorm 0.7883 ± 0.0100 0.7904 ± 0.0115 Shengjie Luo Paper, Code 526,201 NVIDIA Tesla P100 (16GB GPU) Sep 16, 2020
9 HIMP 0.7880 ± 0.0082 Please tell us Matthias Fey Paper, Code 153,029 GeForce RTX 2080 (11GB GPU) Jun 22, 2020
10 DeeperGCN 0.7858 ± 0.0117 0.8427 ± 0.0063 Guohao Li - DeepGCNs.org Paper, Code 531,976 NVIDIA Tesla V100 (32GB GPU) Jun 16, 2020
11 EGC-M (No Edge Features) 0.7818 ± 0.0153 0.8396 ± 0.0097 Shyam Tailor Paper, Code 317,265 GTX1080Ti/RTX2080Ti Apr 6, 2021
12 GSN 0.7799 ± 0.0100 0.8658 ± 0.0084 Giorgos Bouritsas Paper, Code 3,338,701 NVIDIA Tesla V100-SXM2 (16GB) Jan 5, 2021
13 WEGL 0.7757 ± 0.0111 0.8101 ± 0.0097 Navid Naderializadeh Paper, Code 361,064 NVIDIA Tesla P100 (16GB GPU) Jun 26, 2020
14 GIN+virtual node+FLAG 0.7748 ± 0.0096 0.8438 ± 0.0128 Kezhi Kong Paper, Code 3,336,306 GeForce RTX 2080 Ti (11GB GPU) Oct 20, 2020
15 EGC-S (No Edge Features) 0.7721 ± 0.0110 0.8366 ± 0.0074 Shyam Tailor Paper, Code 317,013 GTX1080Ti/RTX2080T Apr 6, 2021
16 GIN+virtual node 0.7707 ± 0.0149 0.8479 ± 0.0068 Weihua Hu – OGB team Paper, Code 3,336,306 GeForce RTX 2080 (11GB GPU) May 1, 2020
17 GCN+FLAG 0.7683 ± 0.0102 0.8176 ± 0.0087 Kezhi Kong Paper, Code 527,701 GeForce RTX 2080 Ti (11GB GPU) Oct 20, 2020
18 GIN+FLAG 0.7654 ± 0.0114 0.8225 ± 0.0155 Kezhi Kong Paper, Code 1,885,206 GeForce RTX 2080 Ti (11GB GPU) Oct 20, 2020
19 GCN 0.7606 ± 0.0097 0.8204 ± 0.0141 Weihua Hu – OGB team Paper, Code 527,701 GeForce RTX 2080 (11GB GPU) May 1, 2020
20 GCN+virtual node 0.7599 ± 0.0119 0.8384 ± 0.0091 Weihua Hu – OGB team Paper, Code 1,978,801 GeForce RTX 2080 (11GB GPU) May 1, 2020
21 GIN 0.7558 ± 0.0140 0.8232 ± 0.0090 Weihua Hu – OGB team Paper, Code 1,885,206 GeForce RTX 2080 (11GB GPU) May 1, 2020


Leaderboard for ogbg-molpcba

The Average Precision (AP) score on the test and validation sets. The higher, the better.

Note: The evaluation metric has been changed from PRC-AUC (Aug 11, 2020).

Package: >=1.2.2

Rank Method Test AP Validation AP Contact References #Params Hardware Date
1 GINE+ w/ APPNP 0.2979 ± 0.0030 0.3126 ± 0.0023 Weibin Li (PaddleHelix & PGL) Paper, Code 6,147,029 Tesla V100 (32GB) Mar 15, 2021
2 PHC-GNN 0.2947 ± 0.0026 0.3068 ± 0.0025 Tuan Le Paper, Code 1,690,328 Tesla V100 (32GB) Apr 14, 2021
3 GINE+ w/ virtual nodes 0.2917 ± 0.0015 0.3065 ± 0.0030 Rémy Brossard Paper, Code 6,147,029 GeForce GTX 1080 Ti Dec 1, 2020
4 DGN 0.2885 ± 0.0030 0.2970 ± 0.0021 Dominique Beaini Paper, Code 6,732,696 NVIDIA T4 GPU (16 GB) Mar 4, 2021
5 DeeperGCN+virtual node+FLAG 0.2842 ± 0.0043 0.2952 ± 0.0029 Kezhi Kong Paper, Code 5,550,208 NVIDIA Tesla V100 (32GB GPU) Oct 21, 2020
6 PNA 0.2838 ± 0.0035 0.2926 ± 0.0026 Dominique Beaini Paper, Code 6,550,839 NVIDIA T4 GPU (16 GB) Mar 4, 2021
7 GIN+virtual node+FLAG 0.2834 ± 0.0038 0.2912 ± 0.0026 Kezhi Kong Paper, Code 3,374,533 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
8 DeeperGCN+virtual node 0.2781 ± 0.0038 0.2920 ± 0.0025 Guohao Li - DeepGCNs.org Paper, Code 5,550,208 NVIDIA Tesla V100 (32GB GPU) Aug 11, 2020
9 GIN+virtual node 0.2703 ± 0.0023 0.2798 ± 0.0025 Weihua Hu – OGB team Paper, Code 3,374,533 GeForce RTX 2080 (11GB GPU) Aug 11, 2020
10 GCN+virtual node+FLAG 0.2483 ± 0.0037 0.2556 ± 0.0040 Kezhi Kong Paper, Code 2,017,028 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
11 GCN+virtual node 0.2424 ± 0.0034 0.2495 ± 0.0042 Weihua Hu – OGB team Paper, Code 2,017,028 GeForce RTX 2080 (11GB GPU) Aug 11, 2020
12 GIN+FLAG 0.2395 ± 0.0040 0.2451 ± 0.0042 Kezhi Kong Paper, Code 1,923,433 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
13 ChebNet 0.2306 ± 0.0016 0.2372 ± 0.0018 Axel Nilsson Paper, Code 1,475,003 GeForce RTX 2070 8GB Dec 28, 2020
14 GIN 0.2266 ± 0.0028 0.2305 ± 0.0027 Weihua Hu – OGB team Paper, Code 1,923,433 GeForce RTX 2080 (11GB GPU) Aug 11, 2020
15 GCN+FLAG 0.2116 ± 0.0017 0.2150 ± 0.0022 Kezhi Kong Paper, Code 565,928 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
16 MorganFP+Rand. Forest 0.2054 ± 0.0004 0.2226 ± 0.0002 Cyrus Maher Paper, Code 29,440,000 CPU Sep 21, 2020
17 GCN 0.2020 ± 0.0024 0.2059 ± 0.0033 Weihua Hu – OGB team Paper, Code 565,928 GeForce RTX 2080 (11GB GPU) Aug 11, 2020


Leaderboard for ogbg-ppa

The multi-class classification accuracy on the test and validation sets. The higher, the better.

Package: >=1.1.1

Rank Method Test Accuracy Validation Accuracy Contact References #Params Hardware Date
1 ExpC 0.7976 ± 0.0072 0.7518 ± 0.0080 Mingqi Yang Paper, Code 1,369,397 NVIDIA Tesla V100 (32GB GPU) Dec 14, 2020
2 DeeperGCN+FLAG 0.7752 ± 0.0069 0.7484 ± 0.0052 Kezhi Kong Paper, Code 2,336,421 NVIDIA Tesla V100 (32GB GPU) Oct 21, 2020
3 DeeperGCN 0.7712 ± 0.0071 0.7313 ± 0.0078 Guohao Li - DeepGCNs.org Paper, Code 2,336,421 NVIDIA Tesla V100 (32GB GPU) Jun 16, 2020
4 GIN+virtual node+FLAG 0.7245 ± 0.0114 0.6789 ± 0.0079 Kezhi Kong Paper, Code 3,288,042 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
5 GIN+virtual node 0.7037 ± 0.0107 0.6678 ± 0.0105 Weihua Hu – OGB team Paper, Code 3,288,042 GeForce RTX 2080 (11GB GPU) May 1, 2020
6 GCN+virtual node+FLAG 0.6944 ± 0.0052 0.6638 ± 0.0055 Kezhi Kong Paper, Code 1,930,537 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
7 GIN+FLAG 0.6905 ± 0.0092 0.6465 ± 0.0070 Kezhi Kong Paper, Code 1,836,942 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
8 GIN 0.6892 ± 0.0100 0.6562 ± 0.0107 Weihua Hu – OGB team Paper, Code 1,836,942 GeForce RTX 2080 (11GB GPU) May 1, 2020
9 GCN+virtual node 0.6857 ± 0.0061 0.6511 ± 0.0048 Weihua Hu – OGB team Paper, Code 1,930,537 GeForce RTX 2080 (11GB GPU) May 1, 2020
10 GCN 0.6839 ± 0.0084 0.6497 ± 0.0034 Weihua Hu – OGB team Paper, Code 479,437 GeForce RTX 2080 (11GB GPU) May 1, 2020


Leaderboard for ogbg-code2

The F1 score on the test and validation sets. The higher, the better.

Package: >=1.2.5

Deprecated ogbg-code leaderboard can be found here.
Rank Method Test F1 score Validation F1 score Contact References #Params Hardware Date
1 DAGNN 0.1751 ± 0.0049 0.1607 ± 0.0040 Veronika Thost Paper, Code 35,246,814 2 GPUs, Tesla V100 PCIe 16GB Apr 8, 2021
2 GCN+virtual node 0.1595 ± 0.0018 0.1461 ± 0.0013 Weihua Hu – OGB team Paper, Code 12,484,310 GeForce RTX 2080 (11GB GPU) Feb 24, 2021
2 EGC-M (No Edge Features) 0.1595 ± 0.0019 0.1464 ± 0.0021 Shyam Tailor Paper, Code 10,986,002 GTX1080Ti/RTX2080Ti Apr 6, 2021
3 GIN+virtual node 0.1581 ± 0.0026 0.1439 ± 0.0020 Weihua Hu – OGB team Paper, Code 13,841,815 GeForce RTX 2080 (11GB GPU) Feb 24, 2021
4 PNA (No Edge Features) 0.1570 ± 0.0032 0.1453 ± 0.0025 Shyam Tailor Paper, Code 10,992,050 V100 Apr 6, 2021
5 MPNN-Max (No Edge Features) 0.1552 ± 0.0022 0.1441 ± 0.0016 Shyam Tailor Paper, Code 10,971,506 GTX1080Ti/RTX2080Ti Apr 6, 2021
6 EGC-S (No Edge Features) 0.1528 ± 0.0025 0.1427 ± 0.0020 Shyam Tailor Paper, Code 11,156,530 GTX1080Ti/RTX2080Ti Apr 6, 2021
7 GCN 0.1507 ± 0.0018 0.1399 ± 0.0017 Weihua Hu – OGB team Paper, Code 11,033,210 GeForce RTX 2080 (11GB GPU) Feb 24, 2021
8 GIN 0.1495 ± 0.0023 0.1376 ± 0.0016 Weihua Hu – OGB team Paper, Code 12,390,715 GeForce RTX 2080 (11GB GPU) Feb 24, 2021