Schedule

StatusEventDate (UTC)Link
Training set releaseMar 31Zenodo
Development set releaseJun 14Zenodo
Additional set 1 - 85k tweets w/ disease mentions (Silver Standard)
Jun 27Zenodo
Validation predictions due [Practice Phase] [Required]Jul 4-
Additional set 2 - 85k tweets w/ additional mentions (Silver Standard)Jul 6Zenodo
Test set release (without annotations)Jul 11Zenodo
Test set predictions due [Evaluation Phase]Jul 15-
Test set evaluation scores releaseJul 25TBA
System descriptions dueAug 1TBA
Acceptance notificationAug. 15
TBA
Camera ready system descriptionsSep 1TBA
SMM4H workshop at Coling conference Oct 12-17COLING 2022

Publications

by socialdisner

SocialDisNER’s overview paper:

Luis Gasco Sánchez, Darryl Estrada Zavala, Eulàlia Farré-Maduell, Salvador Lima-López, Antonio Miranda-Escalada, and Martin Krallinger. 2022. The SocialDisNER shared task on detection of disease mentions in health-relevant content from social media: methods, evaluation, guidelines and corpora. In Proceedings of The Seventh Workshop on Social Media Mining for Health Applications, Workshop & Shared Task, pages 182–189, Gyeongju, Republic of Korea. Association for Computational Linguistics.

URL: https://aclanthology.org/2022.smm4h-1.48/

SMM4H 2022 overview paper:

Davy Weissenbacher, Juan Banda, Vera Davydova, Darryl Estrada Zavala, Luis Gasco Sánchez, Yao Ge, Yuting Guo, Ari Klein, Martin Krallinger, Mathias Leddin, Arjun Magge, Raul Rodriguez-Esteban, Abeed Sarker, Lucia Schmidt, Elena Tutubalina, and Graciela Gonzalez-Hernandez. 2022. Overview of the Seventh Social Media Mining for Health Applications (#SMM4H) Shared Tasks at COLING 2022. In Proceedings of The Seventh Workshop on Social Media Mining for Health Applications, Workshop & Shared Task, pages 221–241, Gyeongju, Republic of Korea. Association for Computational Linguistics.

URL: https://aclanthology.org/2022.smm4h-1.54/

Participants papers:

Workshop

by socialdisner

SocialDISNER will be part of the Social Media Mining for Health 2022 (#SMM4H) workshop at the COLING 2022 (the 29th International Conference On Computational Linguistics), that takes place in October at Gyeongju (Republic of Korea).

COLING is one of the leading conferences on natural language processing and computational linguistics and attracts participants from both top research centers and emerging countries.

SocialDISNER participants are required to write a short-paper describing the system(s) they ran on the test data. Some sample description systems can be found on pages 89-136 of the #SMM4H 2019 proceedings. Accepted system descriptions will be included in the #SMM4H 2022 proceedings.

We encourage at least one author of each accepted system description to register for the #SMM4H 2022 Workshop, co-located at COLING, and present their system as a poster. Selected participants, as determined by the program committee, will be invited to extend their system description to up to four pages, plus unlimited references, and present their system orally.

Contact & FAQ

by socialdisner

Email Martin Krallinger to Krallinger.Martin@gmail.com , Luis Gasco to luis.gasco@bsc.es , and Darryl Estrada to darryl.estrada@bsc.es


  1. Q: What is the goal of the shared task?
    The goal is to predict the named entities of the tweets in the test and background sets.

  2. Q: How do I register?
    Here: Google Form

  3. Q: How do I submit the results?
    In CodaLab.

  4. Q: Can I use additional training data to improve model performance?
    Yes
    , participants may use any additional training data they have available, as long as they describe it in the system description.


  5. Q: Is there a Google Group for the SocialDisNER task?
    Yes: Google Group

Registration

by socialdisner

To participate in the task, please be sure to complete the following steps:

  1. Register on Google Form. Please, choose a team name you remember since we will use it throughout the whole competition and select the Task 10 option:
  2. Login/Register in our CodaLab task in order to upload your predictions:

Important note: Student registrants are required to provide the name and email address of a faculty team member who has agreed to serve as their advisor/mentor for developing their system and writing their system description (see below). By registering for a task, participants agree to run their system on the test data and upload at least one set of predictions to CodaLab. Teams may upload up to three sets of predictions per task. By receiving access to the annotated tweets, participants agree to Twitter’s Terms of Service and may not redistribute any portion of the data.