Check leaderboards for
Note: These leaderboards are deprecated and will no longer updated.
The bold method name indicates that the implementation is official (by the author of the original paper).
Package denotes the required package version for each dataset to be eligible for the leaderboard.
Deprecated Leaderboard for ogbl-citation
The MRR score on the test and validation sets. The higher, the better.
Package: >=1.1.1, <=1.2.3
Deprecated due to a bug in test/val negative samples. ogbl-citation2
fixes the issue.
The new leaderboard for ogbl-citation2
can be found here.
Rank |
Method |
Ext. data |
Test MRR |
Validation MRR |
Contact |
References |
#Params |
Hardware |
Date |
1 |
SEAL |
No |
0.8527 ± 0.0091 |
0.8509 ± 0.0088 |
Muhan Zhang |
Paper, Code |
871,106 |
Tesla V100 (32GB GPU) |
Oct 14, 2020 |
2 |
Full-batch GCN |
No |
0.8456 ± 0.0110 |
0.8449 ± 0.0108 |
Matthias Fey – OGB team |
Paper, Code |
296,449 |
Quadro RTX 8000 (48GB GPU) |
Jun 20, 2020 |
3 |
DeepWalk |
No |
0.8284 ± 0.0005 |
Please tell us |
Hao Xiong (DGL) |
Paper, Code |
757,943,019 |
g4dn.2xlarge, T4 (15GB GPU) |
Jul 23, 2020 |
4 |
Full-batch GraphSAGE |
No |
0.8228 ± 0.0084 |
0.8217 ± 0.0086 |
Matthias Fey – OGB team |
Paper, Code |
460,289 |
Quadro RTX 8000 (48GB GPU) |
Jun 20, 2020 |
5 |
DeepWalk |
No |
0.8148 ± 0.0004 |
Please tell us |
Hao Xiong (DGL) |
Paper, Code |
757,943,019 |
g4dn.2xlarge, T4 (15GB GPU) |
Jun 30, 2020 |
6 |
NeighborSampling (SAGE aggr) |
No |
0.8048 ± 0.0015 |
0.8048 ± 0.0015 |
Matthias Fey – OGB team |
Paper, Code |
460,289 |
GeForce RTX 2080 (11GB GPU) |
Jun 10, 2020 |
7 |
ClusterGCN (GCN aggr) |
No |
0.8021 ± 0.0029 |
0.7999 ± 0.0027 |
Matthias Fey – OGB team |
Paper, Code |
296,449 |
GeForce RTX 2080 (11GB GPU) |
Jun 10, 2020 |
8 |
GraphSAINT (GCN aggr) |
No |
0.7943 ± 0.0043 |
0.7933 ± 0.0046 |
Matthias Fey – OGB team |
Paper, Code |
296,449 |
GeForce RTX 2080 (11GB GPU) |
Jun 10, 2020 |
9 |
Node2vec |
No |
0.5964 ± 0.0011 |
0.5944 ± 0.0011 |
Matthias Fey – OGB team |
Paper, Code |
374,911,105 |
GeForce RTX 2080 (11GB GPU) |
Jun 10, 2020 |
10 |
Matrix Factorization |
No |
0.5316 ± 0.0565 |
0.5311 ± 0.0565 |
Matthias Fey – OGB team |
Paper, Code |
281,113,505 |
GeForce RTX 2080 (11GB GPU) |
Jun 10, 2020 |
Deprecated Leaderboard for ogbl-wikikg
The MRR score on the test and validation sets. The higher, the better.
Package: >=1.1.1, <=1.2.3
Deprecated due to a bug in test/val negative samples. ogbl-wikikg2
fixes the issue.
The new leaderboard for ogbl-wikikg2
can be found here.
Rank |
Method |
Ext. data |
Test MRR |
Validation MRR |
Contact |
References |
#Params |
Hardware |
Date |
1 |
PairRE |
No |
0.5289 ± 0.0030 |
0.5529 ± 0.0010 |
Linlin Chao (AntGroup KG&NLP) |
Paper, Code |
500,334,800 |
Tesla P100 (16GB GPU) |
Nov 9, 2020 |
2 |
TransE (600dim) |
No |
0.4536 ± 0.0028 |
0.4587 ± 0.0031 |
Hongyu Ren – OGB team |
Paper, Code |
1,500,683,400 |
Quadro RTX 8000 (48GB GPU) |
Jun 20, 2020 |
3 |
ComplEx (300dim) |
No |
0.4028 ± 0.0033 |
0.3787 ± 0.0036 |
Hongyu Ren – OGB team |
Paper, Code |
1,500,683,400 |
Quadro RTX 8000 (48GB GPU) |
Jun 20, 2020 |
4 |
ComplEx (50dim) |
No |
0.3877 ± 0.0051 |
0.3612 ± 0.0063 |
Hongyu Ren – OGB team |
Paper, Code |
250,113,900 |
GeForce RTX 2080 (11GB GPU) |
May 1, 2020 |
5 |
RotatE (300dim) |
No |
0.3626 ± 0.0041 |
0.3613 ± 0.0031 |
Hongyu Ren – OGB team |
Paper, Code |
1,500,522,900 |
Quadro RTX 8000 (48GB GPU) |
Jun 20, 2020 |
6 |
DistMult (600dim) |
No |
0.3612 ± 0.0030 |
0.3403 ± 0.0009 |
Hongyu Ren – OGB team |
Paper, Code |
1,500,683,400 |
Quadro RTX 8000 (48GB GPU) |
Jun 20, 2020 |
7 |
DistMult (100dim) |
No |
0.3434 ± 0.0079 |
0.3142 ± 0.0066 |
Hongyu Ren – OGB team |
Paper, Code |
250,113,900 |
GeForce RTX 2080 (11GB GPU) |
May 1, 2020 |
8 |
RotatE (50dim) |
No |
0.2681 ± 0.0047 |
0.2366 ± 0.0043 |
Hongyu Ren – OGB team |
Paper, Code |
250,087,150 |
GeForce RTX 2080 (11GB GPU) |
May 1, 2020 |
9 |
TransE (100dim) |
No |
0.2535 ± 0.0036 |
0.2314 ± 0.0035 |
Hongyu Ren – OGB team |
Paper, Code |
250,113,900 |
GeForce RTX 2080 (11GB GPU) |
May 1, 2020 |
Deprecated Leaderboard for ogbg-code
The F1 score on the test and validation sets. The higher, the better.
Package: >=1.2.0, <=1.2.4
The new leaderboard for ogbg-code2
can be found here.
Rank |
Method |
Ext. data |
Test F1 score |
Validation F1 score |
Contact |
References |
#Params |
Hardware |
Date |
1 |
DAGNN |
No |
0.3454 ± 0.0032 |
0.3238 ± 0.0032 |
Veronika Thost |
Paper, Code |
35,246,814 |
2 GPUs, Tesla V100 PCIe 16GB |
Feb 3, 2021 |
2 |
GCN+virtual node+FLAG |
No |
0.3316 ± 0.0025 |
0.3099 ± 0.0016 |
Kezhi Kong |
Paper, Code |
12,476,210 |
GeForce RTX 2080 Ti (11GB GPU) |
Oct 21, 2020 |
3 |
GIN+virtual node+FLAG |
No |
0.3296 ± 0.0036 |
0.3092 ± 0.0035 |
Kezhi Kong |
Paper, Code |
13,833,715 |
GeForce RTX 2080 Ti (11GB GPU) |
Oct 21, 2020 |
4 |
GCN+virtual node |
No |
0.3263 ± 0.0013 |
0.3062 ± 0.0007 |
Weihua Hu – OGB team |
Paper, Code |
12,476,210 |
GeForce RTX 2080 (11GB GPU) |
Jun 10, 2020 |
5 |
GIN+FLAG |
No |
0.3241 ± 0.0040 |
0.3044 ± 0.0039 |
Kezhi Kong |
Paper, Code |
12,382,615 |
GeForce RTX 2080 Ti (11GB GPU) |
Oct 21, 2020 |
6 |
GCN+FLAG |
No |
0.3209 ± 0.0019 |
0.3016 ± 0.0016 |
Kezhi Kong |
Paper, Code |
11,025,110 |
GeForce RTX 2080 Ti (11GB GPU) |
Oct 21, 2020 |
7 |
GIN+virtual node |
No |
0.3204 ± 0.0018 |
0.3020 ± 0.0016 |
Weihua Hu – OGB team |
Paper, Code |
13,833,715 |
GeForce RTX 2080 (11GB GPU) |
Jun 10, 2020 |
8 |
GCN |
No |
0.3163 ± 0.0018 |
0.2973 ± 0.0014 |
Weihua Hu – OGB team |
Paper, Code |
11,025,110 |
GeForce RTX 2080 (11GB GPU) |
Jun 10, 2020 |
8 |
GIN |
No |
0.3163 ± 0.0020 |
0.2981 ± 0.0014 |
Weihua Hu – OGB team |
Paper, Code |
12,382,615 |
GeForce RTX 2080 (11GB GPU) |
Jun 10, 2020 |