User Tools

Site Tools


wg3:wg3_meeting_2024-10-01_edit

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision
Previous revision
wg3:wg3_meeting_2024-10-01_edit [2025/01/30 09:42] – created gulsen.eryigitwg3:wg3_meeting_2024-10-01_edit [2025/01/30 09:51] (current) gulsen.eryigit
Line 3: Line 3:
 === Reports from Subtask Groups === === Reports from Subtask Groups ===
  
-  * Task 3.1: Documentation of tools/resources (Noémi Ligeti-Nagy)[Slides] +  * Task 3.1: Documentation of tools/resources (Noémi Ligeti-Nagy) {{:wg3:t3.1.pdf|Slides}} 
-  * Task 3.2: Evaluation campaign on morphosyntactic parsing (Omer Goldman) [Guidelines] +  * Task 3.2: Evaluation campaign on morphosyntactic parsing (Omer Goldman) [[https://github.com/omagolda/msap-docs/blob/main/docs.md|Guidelines]
-  * Task 3.3: Conceptions of multilinguality (Adriana Pagano) [Slides]+  * Task 3.3: Conceptions of multilinguality (Adriana Pagano) {{:wg3:t3.3.pdf|Slides}}
  
 ===Call for evaluation campaign proposals (Gülşen Eryiğit):=== ===Call for evaluation campaign proposals (Gülşen Eryiğit):===
  
-We invite proposals for evaluation campaigns to be run as part of EU Unidive Cost Action. Unidive workgroup WG3 “MULTILINGUAL AND CROSS-LINGUAL LANGUAGE TECHNOLOGY” is dedicated to coordinating the development of tools leveraging universality and promoting diversity. According to the memorandum of understanding (MOU), WG3 should coordinate these activities notably by organizing multilingual evaluation campaigns on parsing and MWE identification. However, given that 1) the MOU was written quite some time ago, 2) the first task already put into action in WG3 focuses on morphosyntactic parsing, and 3) the field is advancing rapidly today, we believe that incorporating current technologies, such as large language models (LLMs), into the scope of the proposals is desirable. Unified modeling helps solve NLP tasks with higher accuracy and better awareness of diversity. For these reasons, in this call for evaluation campaigns, we welcome any type of task that aims at different types of idiosyncrasies and diversities, including but not limited to MWE identification, LLMs, idiom identification. We encourage the entire Unidive community (not limited to WG3 members) to come up with task ideas that could be interesting for our network. While it's not a strict requirement, we highly encourage proposals that are based on pilot studies with preliminary data, evaluation measures, and baselines already established. Please feel free to reach out to the WG3 leaders to discuss your idea at your convenience.+ We invite proposals for evaluation campaigns to be run as part of EU Unidive Cost Action. Unidive workgroup WG3 “MULTILINGUAL AND CROSS-LINGUAL LANGUAGE TECHNOLOGY” is dedicated to coordinating the development of tools leveraging universality and promoting diversity. According to the memorandum of understanding (MOU), WG3 should coordinate these activities notably by organizing multilingual evaluation campaigns on parsing and MWE identification. However, given that 1) the MOU was written quite some time ago, 2) the first task already put into action in WG3 focuses on morphosyntactic parsing, and 3) the field is advancing rapidly today, we believe that incorporating current technologies, such as large language models (LLMs), into the scope of the proposals is desirable. Unified modeling helps solve NLP tasks with higher accuracy and better awareness of diversity. For these reasons, in this call for evaluation campaigns, we welcome any type of task that aims at different types of idiosyncrasies and diversities, including but not limited to MWE identification, LLMs, idiom identification. We encourage the entire Unidive community (not limited to WG3 members) to come up with task ideas that could be interesting for our network. While it's not a strict requirement, we highly encourage proposals that are based on pilot studies with preliminary data, evaluation measures, and baselines already established. Please feel free to reach out to the WG3 leaders to discuss your idea at your convenience.
  
 ==Task Selection== ==Task Selection==
Line 35: Line 35:
  
 Next meeting (online): November 19, 2024, 12.00 CET Next meeting (online): November 19, 2024, 12.00 CET
 +
  Rescheduled: November 27, 12.00 CET  Rescheduled: November 27, 12.00 CET
- List of Participants 
-Joakim Nivre (chair) 
-Gülşen Eryiğit (co-chair) 
-Amanda Kann 
-Adriana Pagano 
-Manon Scholivet 
-Agata Savary 
-Natasha Ringbom  
-Csilla Horváth 
-Tanja Samardzic 
-Louis Estève 
-Noémi Ligeti-Nagy 
-Federica Iurescia 
-Claudia Corbetta 
-Alina Wróblewska 
-Miryam de Lhoneux 
-Dawit J. 
-Inguna Skadiņa 
-Radovan Garabík 
-Ivelina Stoyanova 
-Rusudan Makhachashvili 
-Federica Gamba 
-Omer Goldman 
-Tunga Güngör 
-Daniel Zeman 
-Faruk Mardan 
-Martin Benjamin 
-Wessel Poelman 
-Lucía Amorós-Poveda 
  
 +===List of Participants===
 +
 +  * Joakim Nivre (chair)
 +  * Gülşen Eryiğit (co-chair)
 +  * Amanda Kann
 +  * Adriana Pagano
 +  * Manon Scholivet
 +  * Agata Savary
 +  * Natasha Ringbom 
 +  * Csilla Horváth
 +  * Tanja Samardzic
 +  * Louis Estève
 +  * Noémi Ligeti-Nagy
 +  * Federica Iurescia
 +  * Claudia Corbetta
 +  * Alina Wróblewska
 +  * Miryam de Lhoneux
 +  * Dawit J.
 +  * Inguna Skadiņa
 +  * Radovan Garabík
 +  * Ivelina Stoyanova
 +  * Rusudan Makhachashvili
 +  * Federica Gamba
 +  * Omer Goldman
 +  * Tunga Güngör
 +  * Daniel Zeman
 +  * Faruk Mardan
 +  * Martin Benjamin
 +  * Wessel Poelman
 +  * Lucía Amorós-Poveda
 +  * 
wg3/wg3_meeting_2024-10-01_edit.1738226557.txt.gz · Last modified: by gulsen.eryigit