{"id":3975,"date":"2019-09-19T12:34:05","date_gmt":"2019-09-19T12:34:05","guid":{"rendered":"http:\/\/temu.bsc.es\/meddocan\/?p=3975"},"modified":"2022-04-21T14:37:29","modified_gmt":"2022-04-21T13:37:29","slug":"evaluation","status":"publish","type":"post","link":"https:\/\/temu.bsc.es\/distemist\/evaluation\/","title":{"rendered":"Evaluation"},"content":{"rendered":"\n<p>Evaluation will be done by comparing the automatically generated results to the results generated by manual annotation of experts. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Evaluation metrics<\/h2>\n\n\n\n<p>The primary evaluation metric for the sub-track 1 (DisTEMIST &#8211; entities) and sub-track 2 (DISTEMIST &#8211; linking) will consist of <em>micro-averaged precision, recall and F1-scores<\/em>:<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large\"><img decoding=\"async\" src=\"http:\/\/temu.bsc.es\/cantemist\/wp-content\/uploads\/2020\/01\/cantemist_figure3.png\" alt=\"\" class=\"wp-image-4317\"\/><\/figure><\/div>\n\n\n\n<p>The used evaluation scripts together with a Readme file with instructions are available on <a rel=\"noreferrer noopener\" href=\"https:\/\/github.com\/TeMU-BSC\/distemist_evaluation_library\" target=\"_blank\">GitHub<\/a> to enable systematic fine-tuning and improvement of results on the provided training data using by participating teams.<\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Evaluation will be done by comparing the automatically generated results to the results generated by manual annotation of experts. Evaluation metrics The primary evaluation metric for the sub-track 1 (DisTEMIST &#8211; entities) and sub-track 2 (DISTEMIST &#8211; linking) will consist of micro-averaged precision, recall and F1-scores: The used evaluation scripts together with a Readme file [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[],"class_list":["post-3975","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/posts\/3975","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/comments?post=3975"}],"version-history":[{"count":4,"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/posts\/3975\/revisions"}],"predecessor-version":[{"id":4815,"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/posts\/3975\/revisions\/4815"}],"wp:attachment":[{"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/media?parent=3975"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/categories?post=3975"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/tags?post=3975"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}