{"id":9,"date":"2022-01-28T16:09:58","date_gmt":"2022-01-28T15:09:58","guid":{"rendered":"https:\/\/temu.bsc.es\/livingner\/?p=9"},"modified":"2022-03-30T09:26:36","modified_gmt":"2022-03-30T08:26:36","slug":"evaluation","status":"publish","type":"post","link":"https:\/\/temu.bsc.es\/livingner\/2022\/01\/28\/evaluation\/","title":{"rendered":"Evaluation"},"content":{"rendered":"\n<p>Participants&#8217; predictions are compared against the manual Gold Standard (generated by manual annotations of experts). <\/p>\n\n\n\n<p>The primary evaluation metric for the LivingNER-Species NER and  LivingNER-Species Norm sub-tracks consists of micro-averaged precision, recall, and F1 scores:<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"339\" height=\"159\" src=\"https:\/\/temu.bsc.es\/livingner\/wp-content\/uploads\/2022\/03\/cantemist_figure3.png\" alt=\"\" class=\"wp-image-152\" srcset=\"https:\/\/temu.bsc.es\/livingner\/wp-content\/uploads\/2022\/03\/cantemist_figure3.png 339w, https:\/\/temu.bsc.es\/livingner\/wp-content\/uploads\/2022\/03\/cantemist_figure3-300x141.png 300w\" sizes=\"auto, (max-width: 339px) 100vw, 339px\" \/><\/figure><\/div>\n\n\n\n<p>The used evaluation scripts together with proper documentation are freely available on GitHub to enable evaluation tools source code local testing by participating teams. <a rel=\"noreferrer noopener\" href=\"https:\/\/github.com\/tonifuc3m\/livingner-evaluation-library\" target=\"_blank\">Evaluation scripts<\/a>.<\/p>\n\n\n\n<p>More information on LivingNER &#8211; Clinical Impact track TBD<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Participants&#8217; predictions are compared against the manual Gold Standard (generated by manual annotations of experts). The primary evaluation metric for the LivingNER-Species NER and LivingNER-Species Norm sub-tracks consists of micro-averaged precision, recall, and F1 scores: The used evaluation scripts together with proper documentation are freely available on GitHub to enable evaluation tools source code local [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-9","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/posts\/9","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/comments?post=9"}],"version-history":[{"count":7,"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/posts\/9\/revisions"}],"predecessor-version":[{"id":236,"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/posts\/9\/revisions\/236"}],"wp:attachment":[{"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/media?parent=9"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/categories?post=9"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/tags?post=9"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}