OGB-LSC Leaderboards


Steps to submit to leaderboards
  • Carefully read the rules.
  • Develop models and save test-dev prediction using the OGB Evaluator.
  • Submit your result via this page.

Leaderboards policies
  • For each email address on each dataset, another leaderboard submission cannot be made within one week after the last submission. Our system will automatically reject such submissions. Please do not use multiple email addresses within the same team.
  • Extra information (hardware information, training/inference time, validation performance, technical report etc) is required for the OGB-LSC leaderboard submissions. Please check the submission page early to understand what is required.

Check out leaderboards

Package denotes the required package version for each dataset to be eligible for the leaderboards.


Leaderboard for MAG240M

Classification accuracy on the test-dev and validation sets. The higher, the better.

Package: >=1.3.2

Rank Method Ensemble Test-dev Accuracy Validation Accuracy Team Contact References #Params Hardware Date
1 R-GAT (NS) No 0.6931 0.7002 OGB-LSC Matthias Fey (TU Dortmund) Paper, Code 12,255,385 1 GeForce RTX 2080 (11GB GPU) Sep 8, 2021
2 R-GraphSAGE (NS) No 0.6878 0.6986 OGB-LSC Matthias Fey (TU Dortmund) Paper, Code 12,234,905 1 GeForce RTX 2080 (11GB GPU) Sep 8, 2021
3 GAT (NS) No 0.6671 0.6715 OGB-LSC Matthias Fey (TU Dortmund) Paper, Code 4,890,777 1 GeForce RTX 2080 (11GB GPU) Sep 8, 2021
4 GraphSAGE (NS) No 0.6621 0.6679 OGB-LSC Matthias Fey (TU Dortmund) Paper, Code 4,884,633 1 GeForce RTX 2080 (11GB GPU) Sep 8, 2021
5 MLP+C&S No 0.6605 0.6698 OGB-LSC Matthias Fey (TU Dortmund) Paper, Code 473,241 1 GeForce RTX 2080 (11GB GPU) Sep 8, 2021
6 SIGN No 0.6603 0.6664 OGB-LSC Matthias Fey (TU Dortmund) Paper, Code 3,758,233 1 GeForce RTX 2080 (11GB GPU) Sep 8, 2021
7 SGC No 0.6530 0.6582 OGB-LSC Matthias Fey (TU Dortmund) Paper, Code 736,921 1 GeForce RTX 2080 (11GB GPU) Sep 8, 2021
8 LabelProp No 0.5638 0.5844 OGB-LSC Matthias Fey (TU Dortmund) Paper, Code 0 1 GeForce RTX 2080 (11GB GPU) Sep 8, 2021
9 MLP No 0.5276 0.5267 OGB-LSC Matthias Fey (TU Dortmund) Paper, Code 473,241 1 GeForce RTX 2080 (11GB GPU) Sep 8, 2021


Leaderboard for WikiKG90Mv2

MRR on the test-dev and validation sets. The higher, the better.

Package: >=1.3.2

Rank Method Ensemble Test-dev MRR Validation MRR Team Contact References #Params Hardware Date
1 TransE-Concat No 0.1761 0.2060 OGB-LSC Hongyu Ren (Stanford) Paper, Code 18,246,707,000 1 Quadro RTX 8000 (45GB GPU) Oct 12, 2021
1 ComplEx-Concat No 0.1761 0.2048 OGB-LSC Hongyu Ren (Stanford) Paper, Code 18,246,707,000 1 Quadro RTX 8000 (45GB GPU) Oct 12, 2021
2 ComplEx-MPNet No 0.0988 0.1258 OGB-LSC Hongyu Ren (Stanford) Paper, Code 307,600 1 Quadro RTX 8000 (45GB GPU) Oct 12, 2021
3 ComplEx-Shallow No 0.0985 0.1150 OGB-LSC Hongyu Ren (Stanford) Paper, Code 18,246,399,400 1 Quadro RTX 8000 (45GB GPU) Oct 12, 2021
4 TransE-MPNet No 0.0860 0.1128 OGB-LSC Hongyu Ren (Stanford) Paper, Code 307,600 1 Quadro RTX 8000 (45GB GPU) Oct 12, 2021
5 TransE-Shallow No 0.0824 0.1103 OGB-LSC Hongyu Ren (Stanford) Paper, Code 18,246,399,400 1 Quadro RTX 8000 (45GB GPU) Oct 12, 2021


Leaderboard for PCQM4Mv2

MAE on the test-dev and validation sets. The lower, the better.

Package: >=1.3.2

Rank Method Ensemble Test-dev MAE Validation MAE Team Contact References #Params Hardware Date
1 GIN-virtual No 0.1084 0.1083 OGB-LSC Weihua Hu (Stanford) Paper, Code 6,656,406 1 GeForce RTX 2080 (11GB GPU) Sep 8, 2021
2 GCN-virtual No 0.1152 0.1153 OGB-LSC Weihua Hu (Stanford) Paper, Code 4,850,401 1 GeForce RTX 2080 (11GB GPU) Sep 8, 2021
3 GIN No 0.1218 0.1195 OGB-LSC Weihua Hu (Stanford) Paper, Code 3,761,406 1 GeForce RTX 2080 (11GB GPU) Sep 8, 2021
4 GCN No 0.1398 0.1379 OGB-LSC Weihua Hu (Stanford) Paper, Code 1,955,401 1 GeForce RTX 2080 (11GB GPU) Sep 8, 2021
5 MLP-Fingerprint No 0.1760 0.1753 OGB-LSC Weihua Hu (Stanford) Paper, Code 16,107,201 1 GeForce RTX 2080 (11GB GPU) Sep 8, 2021