User Tools

Site Tools


wg3:wg3_meeting_2023-03-17

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
Last revisionBoth sides next revision
wg3:wg3_meeting_2023-03-17 [2023/03/21 16:53] gulsen.eryigitwg3:wg3_meeting_2023-03-17 [2023/09/20 10:28] – [WG3 1st Meeting Minutes - 2023-03-17] joakim.nivre
Line 1: Line 1:
-===== WG3 1st Meeting Minutes - 2023-03-17 =====+===== WG3 1st Meeting Minutes -- 2023-03-17 =====
  
  
 ==== Session 1 ==== ==== Session 1 ====
  
-10.45–11.00 Introduction to WG3 (slides)+10.45–11.00 Introduction to WG3 ({{ :wg3:WG3_1stMeeting_Slides.pdf |slides}})
  
 11.00–11.30 Brainstorming on ideas and expectations 11.00–11.30 Brainstorming on ideas and expectations
Line 69: Line 69:
 13.35–14.20 Initial discussion on evaluation campaigns  13.35–14.20 Initial discussion on evaluation campaigns 
   
- == Background on goals and previous shared tasks (slides) ==+== Background on goals and previous shared tasks ==  
 +({{ :wg3:WG3_1stMeeting_Slides.pdf |slides}}) 
 + 
 +== Brainstorming – define a novel shared task/evaluation campaign: ==
  
- Brainstorming – define a novel shared task/evaluation campaign: 
   * How is the task defined?   * How is the task defined?
   * What are the evaluation metrics?   * What are the evaluation metrics?
Line 77: Line 79:
   * Which languages should be included?   * Which languages should be included?
  
- Ideas:+== Ideas: == 
   * Task = provide resources for shared tasks (eval metrics, test sets)   * Task = provide resources for shared tasks (eval metrics, test sets)
   * Instead of a shared task, build a dynamic leaderboard for LMs   * Instead of a shared task, build a dynamic leaderboard for LMs
Line 90: Line 93:
 14.20–14.30 Next steps 14.20–14.30 Next steps
  
- Next WG3 meeting in Istanbul, September 8, 2023 +  * Next WG3 meeting in Istanbul, September 8, 2023 
- We will focus on documentation of tools +  We will focus on documentation of tools 
- Two tasks in preparation for the meeting: +  Two tasks in preparation for the meeting: 
-A taxonomy of multi- and cross-lingual language technology +  A taxonomy of multi- and cross-lingual language technology 
-An infrastructure for multi- and cross-lingual language technology +  An infrastructure for multi- and cross-lingual language technology 
- Volunteers for these tasks are encouraged to contact WG leaders by email +Volunteers for these tasks are encouraged to contact WG leaders by email
  
-14.30–14.45 Presentation of the European Language Equality project (slides) 
  
 +14.30–14.45 Presentation of the European Language Equality project ({{ :wg3:WG3_1stMeeting_Slides_ELE.pdf |slides}})
  
  
wg3/wg3_meeting_2023-03-17.txt · Last modified: 2023/09/20 10:28 by joakim.nivre