🚀 Submit
Participants are required to prepare their submissions as *.zip files, following the same structure as shown in the Sample submission.
All systems are required to produce valid output in the CoNLL-U format. Each submitted prediction file should adhere to the CoNLL-u format and have the corresponding .conllu extension. Additionally, each prediction file should inherit its name from the corresponding text file. For example, if the input text file is named test.txt, then the prediction file should be named test.conllu.
The directory structure should be:
/<TAGSET_NAME>/<DATASET_NAME>/test.conllu
so in this case it should be:
/ud/idt/test.conllu
For each tagset, you need to provide prediction files for all datasets, otherwise, the submission will be rejected.
You can download a sample submission file below:
When submitting, please provide:
- The name and URL of the benchmarked model.
- Information about the embeddings used for initialisation during training. If no embeddings were used, please denote this with a hyphen (-).
After uploading the prediction, you will see the results of your model. From there, you can choose to publish them on the leaderboard or withdraw your entry.
Please note that for the final evaluation, results are calculated across several datasets, which may take a while for the page to refresh.