Universality, diversity and idiosyncrasy
in language technology
CA21167 COST Action

User Tools

Site Tools

Trace: • wg3_meeting_2023-03-17
wg3:wg3_meeting_2023-03-17

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
wg3:wg3_meeting_2023-03-17 [2023/03/21 16:53] – gulsen.eryigitwg3:wg3_meeting_2023-03-17 [2023/09/20 10:28] (current) – [WG3 1st Meeting Minutes -- 2023-03-17] joakim.nivre
Line 1: Line 1:
-===== WG3 1st Meeting Minutes - 2023-03-17 =====+===== WG3 1st Meeting Minutes – 2023-03-17 =====
  
  
 ==== Session 1 ==== ==== Session 1 ====
  
-10.45–11.00 Introduction to WG3 (slides)+10.45–11.00 Introduction to WG3 ({{ :wg3:WG3_1stMeeting_Slides.pdf |slides}})
  
 11.00–11.30 Brainstorming on ideas and expectations 11.00–11.30 Brainstorming on ideas and expectations
Line 69: Line 69:
 13.35–14.20 Initial discussion on evaluation campaigns  13.35–14.20 Initial discussion on evaluation campaigns 
   
- == Background on goals and previous shared tasks (slides) ==+== Background on goals and previous shared tasks ==  
 +({{ :wg3:WG3_1stMeeting_Slides.pdf |slides}}) 
 + 
 +== Brainstorming – define a novel shared task/evaluation campaign: ==
  
- Brainstorming – define a novel shared task/evaluation campaign: 
   * How is the task defined?   * How is the task defined?
   * What are the evaluation metrics?   * What are the evaluation metrics?
Line 77: Line 79:
   * Which languages should be included?   * Which languages should be included?
  
- Ideas:+== Ideas: == 
   * Task = provide resources for shared tasks (eval metrics, test sets)   * Task = provide resources for shared tasks (eval metrics, test sets)
   * Instead of a shared task, build a dynamic leaderboard for LMs   * Instead of a shared task, build a dynamic leaderboard for LMs
Line 90: Line 93:
 14.20–14.30 Next steps 14.20–14.30 Next steps
  
- Next WG3 meeting in Istanbul, September 8, 2023 +  * Next WG3 meeting in Istanbul, September 8, 2023 
- We will focus on documentation of tools +  * We will focus on documentation of tools 
- Two tasks in preparation for the meeting: +  * Two tasks in preparation for the meeting: 
-A taxonomy of multi- and cross-lingual language technology +  - A taxonomy of multi- and cross-lingual language technology 
-An infrastructure for multi- and cross-lingual language technology +  - An infrastructure for multi- and cross-lingual language technology 
- Volunteers for these tasks are encouraged to contact WG leaders by email +Volunteers for these tasks are encouraged to contact WG leaders by email
  
-14.30–14.45 Presentation of the European Language Equality project (slides) 
  
 +14.30–14.45 Presentation of the European Language Equality project ({{ :wg3:WG3_1stMeeting_Slides_ELE.pdf |slides}})
  
  
wg3/wg3_meeting_2023-03-17.1679414019.txt.gz · Last modified: 2023/03/21 16:53 by gulsen.eryigit