Submission<\/h1>\n\n\n\n

The evaluation of the competition will be done against a manually annotated data set purposely created for this task.<\/p>\n\n\n\n

Submission format<\/h2>\n\n\n\n

Both subtasks, ToxNER (Subtask 1) and ToxUse (Subtask 2), share the same submission format.<\/p>\n\n\n\n

Participating teams must generate a TSV <\/strong>file for each subtask containing the annotations detected in the test documents, following the column structure below:<\/p>\n\n\n\n

\n
• <\/strong>File name (filename):<\/strong> Name of the file from which the entity mention has been extracted<\/li>\n\n\n\n
• Mention label<\/em> (label<\/strong>): The category of the entity.\n
  \n
  • For ToxNER (Subtask 1), the entities could be: Tobacco, Alcohol, Drug, Cannabis<\/em><\/li>\n\n\n\n
  • For ToxUse (Subtask 2) the entities could be: Amount, Type, Frequency, Duration, Method, History<\/em><\/li>\n<\/ul>\n<\/li>\n\n\n\n
  • Starting character offset (off0):<\/strong> Character index where the detected mention starts.<\/li>\n\n\n\n
  • Ending character offset (off1):<\/strong> Character index where the detected mention ends.<\/li>\n\n\n\n
  • Mention span (span):<\/strong> Mention extracted from the text (i.e., the text of the entity)<\/li>\n<\/ul>\n\n\n\n

    Example (submission.tsv<\/strong>):<\/p>\n\n\n\n

    <\/figure>\n\n\n\n

    Submission Procedure<\/h2>\n\n\n\n

    The submissions must be sent via email to < wesam.alnabki.bsc [at] gmail.com <\/span><\/strong>>.<\/p>\n\n\n\n

    All submissions must follow the instructions below:<\/p>\n\n\n\n

    \n
    1. Submission Limit:<\/strong>\n
       \n
       • Each team may submit up to 5 runs per subtask<\/strong> (ToxNER and\/or ToxUse).<\/li>\n<\/ul>\n<\/li>\n\n\n\n
       • Submission Format:<\/strong>\n
         \n
         • Submit one single ZIP file<\/strong> containing your runs with the following structure:
           • A subdirectory for each subtask<\/strong> you are participating in (e.g., ToxNER\/<\/code>, ToxUse\/<\/code>).<\/li>
           • A README.txt<\/strong> file in the root directory including the following:
             • Team name (same as registered)<\/li>
             • Team contact person (name and email)<\/li>
             • Concise description of each run<\/li>
             • Any extra resources used (e.g., dictionaries, external data, pre-trained models)<\/li><\/ul><\/li><\/ul>\u26a0\ufe0f Submissions without a README.txt<\/strong> will not be counted towards the task.<\/li>\n<\/ul>\n<\/li>\n\n\n\n
             • Naming Runs:<\/strong>\n
               \n
               • If you submit multiple runs for a subtask, name the TSV files clearly and sequentially:\n
                 \n
                 • Example: 1-baseline.tsv<\/code>, 2-bert-model.tsv<\/code>, etc.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n\n\n\n
                 • ZIP File Naming Convention:<\/strong>\n
                   \n
                   • Your ZIP file must include:\n
                     \n
                     • Team name (as used in registration)<\/li>\n\n\n\n
                     • Subtask(s) covered<\/li>\n\n\n\n
                     • Submission date as a timestamp (YYYYMMDD)<\/li>\n\n\n\n
                     • Example<\/strong>:
                       toxhabits_teamname_toxner_20240528.zip<\/code>
toxhabits_teamname_toxuse_20240528.zip<\/code><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n\n\n\n
                     • TSV File Requirements:<\/strong>\n
                       \n
                       • Submissions must be in tab-separated files (.tsv)<\/strong> with the following:\n
                         \n
                         • One row per detected mention<\/li>\n\n\n\n
                         • The required columns: filename<\/code>, label<\/code>, off0<\/code>, off1<\/code>, span<\/code><\/li>\n\n\n\n
                         • A header row with column names<\/li>\n\n\n\n
                         • One file per system\/run<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"

                           Submission The evaluation of the competition will be done against a manually annotated data set purposely created for this task. Submission format Both subtasks, ToxNER (Subtask 1) and ToxUse (Subtask 2), share the same submission format. Participating teams must generate a TSV file for each subtask containing the annotations detected in the test documents, following […]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-13","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/temu.bsc.es\/toxhabits\/wp-json\/wp\/v2\/pages\/13","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/temu.bsc.es\/toxhabits\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/temu.bsc.es\/toxhabits\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/temu.bsc.es\/toxhabits\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/temu.bsc.es\/toxhabits\/wp-json\/wp\/v2\/comments?post=13"}],"version-history":[{"count":6,"href":"https:\/\/temu.bsc.es\/toxhabits\/wp-json\/wp\/v2\/pages\/13\/revisions"}],"predecessor-version":[{"id":169,"href":"https:\/\/temu.bsc.es\/toxhabits\/wp-json\/wp\/v2\/pages\/13\/revisions\/169"}],"wp:attachment":[{"href":"https:\/\/temu.bsc.es\/toxhabits\/wp-json\/wp\/v2\/media?parent=13"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}