Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the materialize domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /var/www/html/toxhabits/wp-includes/functions.php on line 6131
{"id":15,"date":"2025-03-27T14:01:53","date_gmt":"2025-03-27T12:01:53","guid":{"rendered":"https:\/\/temu.bsc.es\/toxhabits\/?page_id=15"},"modified":"2025-05-29T16:46:17","modified_gmt":"2025-05-29T14:46:17","slug":"evaluation","status":"publish","type":"page","link":"https:\/\/temu.bsc.es\/toxhabits\/evaluation\/","title":{"rendered":"Evaluation"},"content":{"rendered":"\n

Evaluation<\/h1>\n\n\n\n

The evaluation will be conducted by comparing the automatically generated outputs with the expert-annotated gold standard, ensuring a robust assessment of system performance.<\/p>\n\n\n\n

Evaluation metrics<\/h2>\n\n\n\n

The primary evaluation metric for the ToxNER (Subtask 1) and ToxUse (Subtask 2) will consist of micro-averaged precision, recall and F1-scores<\/em>:<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Evaluation library<\/h2>\n\n\n\n

The evaluation scripts, along with a README file containing detailed instructions, are available on GitHub <\/a>to facilitate systematic fine-tuning and performance improvement on the provided training data by participating teams.<\/p>\n\n\n\n

You can run the script using:<\/p>\n\n\n\n

$> python main.py -g ..\\ground_truth\\gs.tsv -p ..\\dummy_submission\\test_submission.tsv -s ner<\/code><\/pre>\n\n\n\n
<\/p>\n","protected":false},"excerpt":{"rendered":"
Evaluation The evaluation will be conducted by comparing the automatically generated outputs with the expert-annotated gold standard, ensuring a robust assessment of system performance. Evaluation metrics The primary evaluation metric for the ToxNER (Subtask 1) and ToxUse (Subtask 2) will consist of micro-averaged precision, recall and F1-scores: Evaluation library The evaluation scripts, along with a README […]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-15","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/temu.bsc.es\/toxhabits\/wp-json\/wp\/v2\/pages\/15","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/temu.bsc.es\/toxhabits\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/temu.bsc.es\/toxhabits\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/temu.bsc.es\/toxhabits\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/temu.bsc.es\/toxhabits\/wp-json\/wp\/v2\/comments?post=15"}],"version-history":[{"count":6,"href":"https:\/\/temu.bsc.es\/toxhabits\/wp-json\/wp\/v2\/pages\/15\/revisions"}],"predecessor-version":[{"id":161,"href":"https:\/\/temu.bsc.es\/toxhabits\/wp-json\/wp\/v2\/pages\/15\/revisions\/161"}],"wp:attachment":[{"href":"https:\/\/temu.bsc.es\/toxhabits\/wp-json\/wp\/v2\/media?parent=15"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}