We additionally require reporting hardwares and #parameters in the leaderboard submission. Please refer to here for more details.
If you have previously made leaderboard submissions, please tell us the above two information.
The package version requirement has been added for each dataset.
To make sure all the leaderboard submissions use the same datasets and evaluators, we have added the package version requirement for each dataset. It can be checked at both dataset pages (e.g., here) and leaderboard pages (e.g., here).
We highly recommend always using the newest package version. Our data loader only downloads and processes the modified datasets.