Deprecated Leaderboards

Check leaderboards for
- ogbl-citation
- ogbl-wikikg
- ogbg-code
Note: These leaderboards are deprecated and will no longer updated.

The bold method name indicates that the implementation is official (by the author of the original paper).
Package denotes the required package version for each dataset to be eligible for the leaderboard.


Deprecated Leaderboard for ogbl-citation

The MRR score on the test and validation sets. The higher, the better.

Package: >=1.1.1, <=1.2.3

Deprecated due to a bug in test/val negative samples. ogbl-citation2 fixes the issue.
The new leaderboard for ogbl-citation2 can be found here.
Rank Method Test MRR Validation MRR Contact References #Params Hardware Date
1 SEAL 0.8527 ± 0.0091 0.8509 ± 0.0088 Muhan Zhang Paper, Code 871,106 Tesla V100 (32GB GPU) Oct 14, 2020
2 Full-batch GCN 0.8456 ± 0.0110 0.8449 ± 0.0108 Matthias Fey – OGB team Paper, Code 296,449 Quadro RTX 8000 (48GB GPU) Jun 20, 2020
3 DeepWalk 0.8284 ± 0.0005 Please tell us Hao Xiong (DGL) Paper, Code 757,943,019 g4dn.2xlarge, T4 (15GB GPU) Jul 23, 2020
4 Full-batch GraphSAGE 0.8228 ± 0.0084 0.8217 ± 0.0086 Matthias Fey – OGB team Paper, Code 460,289 Quadro RTX 8000 (48GB GPU) Jun 20, 2020
5 DeepWalk 0.8148 ± 0.0004 Please tell us Hao Xiong (DGL) Paper, Code 757,943,019 g4dn.2xlarge, T4 (15GB GPU) Jun 30, 2020
6 NeighborSampling (SAGE aggr) 0.8048 ± 0.0015 0.8048 ± 0.0015 Matthias Fey – OGB team Paper, Code 460,289 GeForce RTX 2080 (11GB GPU) Jun 10, 2020
7 ClusterGCN (GCN aggr) 0.8021 ± 0.0029 0.7999 ± 0.0027 Matthias Fey – OGB team Paper, Code 296,449 GeForce RTX 2080 (11GB GPU) Jun 10, 2020
8 GraphSAINT (GCN aggr) 0.7943 ± 0.0043 0.7933 ± 0.0046 Matthias Fey – OGB team Paper, Code 296,449 GeForce RTX 2080 (11GB GPU) Jun 10, 2020
9 Node2vec 0.5964 ± 0.0011 0.5944 ± 0.0011 Matthias Fey – OGB team Paper, Code 374,911,105 GeForce RTX 2080 (11GB GPU) Jun 10, 2020
10 Matrix Factorization 0.5316 ± 0.0565 0.5311 ± 0.0565 Matthias Fey – OGB team Paper, Code 281,113,505 GeForce RTX 2080 (11GB GPU) Jun 10, 2020


Deprecated Leaderboard for ogbl-wikikg

The MRR score on the test and validation sets. The higher, the better.

Package: >=1.1.1, <=1.2.3

Deprecated due to a bug in test/val negative samples. ogbl-wikikg2 fixes the issue.
The new leaderboard for ogbl-wikikg2 can be found here.
Rank Method Test MRR Validation MRR Contact References #Params Hardware Date
1 PairRE 0.5289 ± 0.0030 0.5529 ± 0.0010 Linlin Chao (AntGroup KG&NLP) Paper, Code 500,334,800 Tesla P100 (16GB GPU) Nov 9, 2020
2 TransE (600dim) 0.4536 ± 0.0028 0.4587 ± 0.0031 Hongyu Ren – OGB team Paper, Code 1,500,683,400 Quadro RTX 8000 (48GB GPU) Jun 20, 2020
3 ComplEx (300dim) 0.4028 ± 0.0033 0.3787 ± 0.0036 Hongyu Ren – OGB team Paper, Code 1,500,683,400 Quadro RTX 8000 (48GB GPU) Jun 20, 2020
4 ComplEx (50dim) 0.3877 ± 0.0051 0.3612 ± 0.0063 Hongyu Ren – OGB team Paper, Code 250,113,900 GeForce RTX 2080 (11GB GPU) May 1, 2020
5 RotatE (300dim) 0.3626 ± 0.0041 0.3613 ± 0.0031 Hongyu Ren – OGB team Paper, Code 1,500,522,900 Quadro RTX 8000 (48GB GPU) Jun 20, 2020
6 DistMult (600dim) 0.3612 ± 0.0030 0.3403 ± 0.0009 Hongyu Ren – OGB team Paper, Code 1,500,683,400 Quadro RTX 8000 (48GB GPU) Jun 20, 2020
7 DistMult (100dim) 0.3434 ± 0.0079 0.3142 ± 0.0066 Hongyu Ren – OGB team Paper, Code 250,113,900 GeForce RTX 2080 (11GB GPU) May 1, 2020
8 RotatE (50dim) 0.2681 ± 0.0047 0.2366 ± 0.0043 Hongyu Ren – OGB team Paper, Code 250,087,150 GeForce RTX 2080 (11GB GPU) May 1, 2020
9 TransE (100dim) 0.2535 ± 0.0036 0.2314 ± 0.0035 Hongyu Ren – OGB team Paper, Code 250,113,900 GeForce RTX 2080 (11GB GPU) May 1, 2020


Deprecated Leaderboard for ogbg-code

The F1 score on the test and validation sets. The higher, the better.

Package: >=1.2.0, <=1.2.4

Deprecated due to prediction target leakage in input graph. ogbg-code2 fixes the issue.
The new leaderboard for ogbg-code2 can be found here.
Rank Method Test F1 score Validation F1 score Contact References #Params Hardware Date
1 DAGNN 0.3454 ± 0.0032 0.3238 ± 0.0032 Veronika Thost Paper, Code 35,246,814 2 GPUs, Tesla V100 PCIe 16GB Feb 3, 2021
2 GCN+virtual node+FLAG 0.3316 ± 0.0025 0.3099 ± 0.0016 Kezhi Kong Paper, Code 12,476,210 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
3 GIN+virtual node+FLAG 0.3296 ± 0.0036 0.3092 ± 0.0035 Kezhi Kong Paper, Code 13,833,715 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
4 GCN+virtual node 0.3263 ± 0.0013 0.3062 ± 0.0007 Weihua Hu – OGB team Paper, Code 12,476,210 GeForce RTX 2080 (11GB GPU) Jun 10, 2020
5 GIN+FLAG 0.3241 ± 0.0040 0.3044 ± 0.0039 Kezhi Kong Paper, Code 12,382,615 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
6 GCN+FLAG 0.3209 ± 0.0019 0.3016 ± 0.0016 Kezhi Kong Paper, Code 11,025,110 GeForce RTX 2080 Ti (11GB GPU) Oct 21, 2020
7 GIN+virtual node 0.3204 ± 0.0018 0.3020 ± 0.0016 Weihua Hu – OGB team Paper, Code 13,833,715 GeForce RTX 2080 (11GB GPU) Jun 10, 2020
8 GCN 0.3163 ± 0.0018 0.2973 ± 0.0014 Weihua Hu – OGB team Paper, Code 11,025,110 GeForce RTX 2080 (11GB GPU) Jun 10, 2020
8 GIN 0.3163 ± 0.0020 0.2981 ± 0.0014 Weihua Hu – OGB team Paper, Code 12,382,615 GeForce RTX 2080 (11GB GPU) Jun 10, 2020