{"id":19,"date":"2025-01-29T11:00:55","date_gmt":"2025-01-29T11:00:55","guid":{"rendered":"https:\/\/temu.bsc.es\/multiclinsum\/?page_id=19"},"modified":"2025-06-04T08:52:13","modified_gmt":"2025-06-04T08:52:13","slug":"evaluation","status":"publish","type":"page","link":"https:\/\/temu.bsc.es\/multiclinsum\/evaluation\/","title":{"rendered":"Evaluation & Submission"},"content":{"rendered":"\n

Important Update:<\/strong> The deadline for result submission has been extended to 4 June at 22:00 CET<\/strong>.<\/mark><\/p>\n\n\n\n

If you had issues in uploading your submission please contact the organizers (Miguel Rodr\u00edguez<\/a>, Eduard Rodr\u00edguez<\/a>, and Martin Krallinger<\/a>) immediately. It seems the submission platform experienced some issues the final submission hour.<\/mark><\/p>\n\n\n\n

Evaluation<\/h1>\n\n\n\n

The evaluation will be done against a set of pairs of full-text clinical case reports and their human-generated summary with the same characteristics as the provided training documents. Two main metrics will be used: Rouge-L-Sum<\/a><\/strong> and BERTScore<\/a><\/strong>. Additional metrics not officially implemented for evaluation purposes might be also used.<\/p>\n\n\n\n

Submission Instructions<\/strong><\/h2>\n\n\n\n

Important information<\/strong> for MultiClinSum participants regarding submission instructions, please read carefully.<\/p>\n\n\n\n

1. MulticlinSum Subtracks<\/strong><\/p>\n\n\n\n

Each sub-track of the MultiClinSum task is independent in the sense that submissions can be done independently for any of the four sub-tracks or languages. It is NOT mandatory to generate predictions or submissions for all languages<\/strong>, thus teams can also generate predictions only for a single language. Also important, for a given language, it is mandatory to generate predictions for all cases in the test set<\/strong>, rather than just a subset.<\/p>\n\n\n\n

Specifically, the four sub-tracks are:<\/p>\n\n\n\n