Evaluation


The primary evaluation metric used for evaluating the participating systems of the BARR track, will be the F1-micro measure.

In order to support the improvement of the automatic prediction tools enrolled in the challenge a BARR track adaptation of the Markyt platform will be provided [1]. The BARR-Markyt evaluation platform will allow registered teams to visualize and compare generated predictions against the Gold Standard annotations.

Please check the evaluation tutorials before submitting your results:

  • BARR entity evaluation tutorial: PDF link
  • BARR relation evaluation tutorial: PDF link

Paper submissions

Please use the following LaTeX template to submit your paper: Zip file. This template is based on this Springer template, we adapted the template so that participants can start directly including the content of the paper. This template is LaTeX only, no Word/LibreOffice template is included.

Please upload your papers here: EasyChair

Results


Coming soon...

System Precision Recall F-Measure
1
2
3
4
...

References:

  1. Pérez-Pérez, M., Pérez-Rodríguez, G., Rabal, O., Vazquez, M., Oyarzabal, J., Fdez-Riverola, F., ... & Lourenço, A. The Markyt visualisation, prediction and benchmark platform for chemical and gene entity recognition at BioCreative/CHEMDNER challenge. Database, 2016, baw120.