wg3:wg3_meeting_2023-03-17
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
wg3:wg3_meeting_2023-03-17 [2023/03/21 16:53] – gulsen.eryigit | wg3:wg3_meeting_2023-03-17 [2023/03/21 16:56] – gulsen.eryigit | ||
---|---|---|---|
Line 69: | Line 69: | ||
13.35–14.20 Initial discussion on evaluation campaigns | 13.35–14.20 Initial discussion on evaluation campaigns | ||
- | == Background on goals and previous shared tasks (slides) == | + | == Background on goals and previous shared tasks (slides) |
+ | |||
+ | == Brainstorming – define a novel shared task/ | ||
- | Brainstorming – define a novel shared task/ | ||
* How is the task defined? | * How is the task defined? | ||
* What are the evaluation metrics? | * What are the evaluation metrics? | ||
Line 77: | Line 78: | ||
* Which languages should be included? | * Which languages should be included? | ||
- | Ideas: | + | == Ideas: |
* Task = provide resources for shared tasks (eval metrics, test sets) | * Task = provide resources for shared tasks (eval metrics, test sets) | ||
* Instead of a shared task, build a dynamic leaderboard for LMs | * Instead of a shared task, build a dynamic leaderboard for LMs | ||
Line 90: | Line 92: | ||
14.20–14.30 Next steps | 14.20–14.30 Next steps | ||
- | Next WG3 meeting in Istanbul, September 8, 2023 | + | Next WG3 meeting in Istanbul, September 8, 2023 |
- | We will focus on documentation of tools | + | We will focus on documentation of tools |
- | Two tasks in preparation for the meeting: | + | Two tasks in preparation for the meeting: |
- | A taxonomy of multi- and cross-lingual language technology | + | |
- | An infrastructure for multi- and cross-lingual language technology | + | |
- | Volunteers for these tasks are encouraged to contact WG leaders by email | + | Volunteers for these tasks are encouraged to contact WG leaders by email |
wg3/wg3_meeting_2023-03-17.txt · Last modified: 2023/09/20 10:28 by joakim.nivre