MEDDOPROF will award the top three teams of each sub-task. For each of them, the team with the highest F1-score will be awarded a prize of 600 euros, the second one with a prize of 300 euros, and the third one with a prize of 100 euros.
In order to encourage participants to support open knowledge, the team will receive the full amount of the prize as long as they open source the model and a script to use it by other members of the community in a public repository such as Github. This repository must have all the necessary files to make it work by a third party. If they do not, a 50% deduction will be applied to the prize amount.
In case of a tie, the decision will be made following these criteria:
- First, it will be checked which system has been made publicly available in an online repository.
- Second, in case both teams have made public their systems, the team that has submitted a short paper describing the operation of the system will win.
If all tied teams meet these criteria, the prize money will be divided equally among the teams.
A template README file to be used in the repository can be downloaded from: https://github.com/PlanTL-SANIDAD/shared-task-resource-example/