The Plan for the Advancement of Language Technology (Plan TL) aims to promote the development of natural language processing, machine translation and conversational systems in Spanish and co-official languages. In the framework of this plan, we announce the call for the shared task awards detailed below.
The first classified in each of the sub-task will receive a prize of 1,000 euros, the second classified in each of the sub-task will receive a prize of 500 euros and the third classified in each of the sub-task will receive a prize of 200 euros.
Registration: Fill in an online registration form. See Registration for further details.
Deadlines for submission: The deadline for submission is May 3, 2020, and the resolution of awards will be after CLEF conference on September 22-25, 2020. For further details, please refer to the Schedule.
Evaluation: The evaluation of the automatic predictions for this task will have three different scenarios or sub-tasks:
- CodiEsp-D. Main evaluation metric: Mean Average Precision.
- CodiEsp-P. Main evaluation metric: Mean Average Precision.
- CodiEsp-X. Main evaluation metric: F-score.
For further details on the evaluation of the sub-tasks, please refer to Evaluation.
Selection of winners: The first 3 classified in the tasks will be selected as finalists to receive prizes. System evaluations will be performed according to the evaluation criteria described in Evaluation.
Contact: For further details, please refer to Martin Krallinger at encargo-pln-life@bsc.es
Official CodiEsp results
**IAM Explainability results are unofficial (see overview paper for more information)