{"id":11,"date":"2022-01-28T16:09:59","date_gmt":"2022-01-28T15:09:59","guid":{"rendered":"https:\/\/temu.bsc.es\/livingner\/?p=11"},"modified":"2022-05-03T11:13:10","modified_gmt":"2022-05-03T10:13:10","slug":"evaluation-library","status":"publish","type":"post","link":"https:\/\/temu.bsc.es\/livingner\/2022\/01\/28\/evaluation-library\/","title":{"rendered":"Evaluation Library"},"content":{"rendered":"\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\"><p><em>The LivingNER evaluation library<\/em>\u00a0is\u00a0<a rel=\"noreferrer noopener\" href=\"https:\/\/github.com\/tonifuc3m\/livingner-evaluation-library\" target=\"_blank\">available on GitHub<\/a>.<\/p><p><em>Please, make sure you have the latest version.<\/em><\/p><\/blockquote>\n\n\n\n<p>Evaluation process: (1) you submit your results, (2) we perform the evaluation off-line and (3) return the final scores.<\/p>\n\n\n\n<p>These scripts are distributed as part of the LivingNER shared task. They are written in Python3 and intended to be run via command line:<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">$&gt; python main.py -g ..\/gs-data\/sample_entities_subtask1.tsv -p ..\/toy-data\/sample_entities_subtask1_MISSING_ONE_FILE.tsv -s ner\n$&gt; python main.py -g ..\/gs-data\/sample_entities_subtask2.tsv -p ..\/toy-data\/sample_entities_subtask2_MISSING_ONE_FILE.tsv -s norm \n$&gt; python main.py -g ..\/gs-data\/sample_entities_subtask3.tsv -p ..\/toy-data\/pred_sample_entities_subtask3.tsv -s app<\/pre>\n\n\n\n<p>They produce the evaluation metrics for the corresponding sub-tracks: precision, recall and F-score for LivingNER Species NER and LivingNER Species NORM.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The LivingNER evaluation library\u00a0is\u00a0available on GitHub. Please, make sure you have the latest version. Evaluation process: (1) you submit your results, (2) we perform the evaluation off-line and (3) return the final scores. These scripts are distributed as part of the LivingNER shared task. They are written in Python3 and intended to be run via [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-11","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/posts\/11","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/comments?post=11"}],"version-history":[{"count":5,"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/posts\/11\/revisions"}],"predecessor-version":[{"id":404,"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/posts\/11\/revisions\/404"}],"wp:attachment":[{"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/media?parent=11"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/categories?post=11"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/temu.bsc.es\/livingner\/wp-json\/wp\/v2\/tags?post=11"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}