{"id":4891,"date":"2022-05-03T14:05:59","date_gmt":"2022-05-03T13:05:59","guid":{"rendered":"https:\/\/temu.bsc.es\/distemist\/?p=4891"},"modified":"2022-05-09T16:26:33","modified_gmt":"2022-05-09T15:26:33","slug":"multilingual-corpus-cross-mappings","status":"publish","type":"post","link":"https:\/\/temu.bsc.es\/distemist\/multilingual-corpus-cross-mappings\/","title":{"rendered":"Multilingual corpus & cross-mappings"},"content":{"rendered":"\n

Annotation guidelines will be available in\u00a0Zenodo<\/a>.<\/p>

DISTEMIST training, test and background sets (including the multilingual corpus and cross-mappings) are available at\u00a0Zenodo<\/a>.<\/p><\/blockquote>\n\n\n\n

DISTEMIST Multilingual corpus<\/h2>\n\n\n\n

We have generated the annotated (and normalized to Snomed-CT) training and validation sets in 6 languages: English, Portuguese, Catalan, Italian, French, and Romanian. The process was:<\/p>\n\n\n\n

  1. The text files were translated with a neural machine translation system.<\/li>
  2. The annotations were translated with the same neural machine translation system.<\/li>
  3. The translated annotations were transferred to the translated text files using an annotation transfer technology.<\/li><\/ol>\n\n\n\n

    If you want to visualize the multilingual resources, check out this Brat server: https:\/\/temu.bsc.es\/mDistemist\/#\/translations\/<\/a>
    For instance, you can see the parallel annotations in     English vs in French<\/a>, or in Spanish (the gold standard) vs in Italian.<\/a><\/p>\n\n\n\n

    \"\"
    Multilingual annotated and normalized corpus process overview<\/figcaption><\/figure><\/div>\n\n\n\n
    \"\"
    Gold Standard (Spanish) vs English annotations visualized with Brat.<\/figcaption><\/figure><\/div>\n\n\n\n

    DISTEMIST cross-mappings<\/strong><\/h2>\n\n\n\n

    The DISTEMIST Gold Standard contains the mentions mapped to Snomed-CT.<\/p>\n\n\n\n

    In the DISTEMIST cross-mappings files we include the same entities as in DISTEMIST-linking but mapped to Snomed-CT, MeSH<\/a>, ICD-10<\/a>, HPO<\/a>, and OMIM<\/a>. The original mappings are manual and to Snomed-CT. The mappings to the other terminologies were done through the UMLS Metathesaurus.<\/p>\n","protected":false},"excerpt":{"rendered":"

    Annotation guidelines will be available in\u00a0Zenodo. DISTEMIST training, test and background sets (including the multilingual corpus and cross-mappings) are available at\u00a0Zenodo. DISTEMIST Multilingual corpus We have generated the annotated (and normalized to Snomed-CT) training and validation sets in 6 languages: English, Portuguese, Catalan, Italian, French, and Romanian. The process was: The text files were translated with a […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-4891","post","type-post","status-publish","format-standard","hentry","category-data"],"_links":{"self":[{"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/posts\/4891","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/comments?post=4891"}],"version-history":[{"count":5,"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/posts\/4891\/revisions"}],"predecessor-version":[{"id":4916,"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/posts\/4891\/revisions\/4916"}],"wp:attachment":[{"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/media?parent=4891"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/categories?post=4891"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/temu.bsc.es\/distemist\/wp-json\/wp\/v2\/tags?post=4891"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}