{"id":23,"date":"2020-12-23T15:27:44","date_gmt":"2020-12-23T15:27:44","guid":{"rendered":"https:\/\/temu.bsc.es\/meddoprof\/?p=23"},"modified":"2021-05-03T11:57:21","modified_gmt":"2021-05-03T09:57:21","slug":"evaluation-library","status":"publish","type":"post","link":"https:\/\/temu.bsc.es\/meddoprof\/evaluation-library\/","title":{"rendered":"Evaluation Library"},"content":{"rendered":"\n<p>MEDDOPROF&#8217;s evaluation will be done using the official evaluation library, which can be downloaded from <a href=\"https:\/\/github.com\/TeMU-BSC\/meddoprof-evaluation-library\">GitHub<\/a>. This library is written in Python 3 and intended to be run via command line:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>$ python main.py -g ..\/gs-data\/ner\/ -p ..\/toy-data\/ner\/ -s ner\n$ python main.py -g ..\/gs-data\/class\/ -p ..\/toy-data\/class -s class\n$ python main.py -g ..\/gs-data\/gs-norm.tsv -p ..\/toy-data\/pred-norm.tsv -c ..\/meddoprof_valid_codes.tsv.tsv -s norm<\/code><\/pre>\n\n\n\n<p>For all subtasks, the relevant metrics are precision, recall and f1-score. The latter will be used to decide the award winners.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>MEDDOPROF&#8217;s evaluation will be done using the official evaluation library, which can be downloaded from GitHub. This library is written in Python 3 and intended to be run via command line: For all subtasks, the relevant metrics are precision, recall and f1-score. The latter will be used to decide the award winners.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[],"class_list":["post-23","post","type-post","status-publish","format-standard","hentry","category-evaluation"],"_links":{"self":[{"href":"https:\/\/temu.bsc.es\/meddoprof\/wp-json\/wp\/v2\/posts\/23","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/temu.bsc.es\/meddoprof\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/temu.bsc.es\/meddoprof\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/temu.bsc.es\/meddoprof\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/temu.bsc.es\/meddoprof\/wp-json\/wp\/v2\/comments?post=23"}],"version-history":[{"count":3,"href":"https:\/\/temu.bsc.es\/meddoprof\/wp-json\/wp\/v2\/posts\/23\/revisions"}],"predecessor-version":[{"id":268,"href":"https:\/\/temu.bsc.es\/meddoprof\/wp-json\/wp\/v2\/posts\/23\/revisions\/268"}],"wp:attachment":[{"href":"https:\/\/temu.bsc.es\/meddoprof\/wp-json\/wp\/v2\/media?parent=23"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/temu.bsc.es\/meddoprof\/wp-json\/wp\/v2\/categories?post=23"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/temu.bsc.es\/meddoprof\/wp-json\/wp\/v2\/tags?post=23"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}