wg3:wg3_meeting_2023-03-17
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revision | Next revisionBoth sides next revision | ||
| wg3:wg3_meeting_2023-03-17 [2023/03/21 16:53] – gulsen.eryigit | wg3:wg3_meeting_2023-03-17 [2023/03/21 16:54] – gulsen.eryigit | ||
|---|---|---|---|
| Line 69: | Line 69: | ||
| 13.35–14.20 Initial discussion on evaluation campaigns | 13.35–14.20 Initial discussion on evaluation campaigns | ||
| - | == Background on goals and previous shared tasks (slides) == | + | == Background on goals and previous shared tasks (slides) |
| + | |||
| + | == Brainstorming – define a novel shared task/ | ||
| - | Brainstorming – define a novel shared task/ | ||
| * How is the task defined? | * How is the task defined? | ||
| * What are the evaluation metrics? | * What are the evaluation metrics? | ||
| Line 77: | Line 78: | ||
| * Which languages should be included? | * Which languages should be included? | ||
| - | Ideas: | + | == Ideas: |
| * Task = provide resources for shared tasks (eval metrics, test sets) | * Task = provide resources for shared tasks (eval metrics, test sets) | ||
| * Instead of a shared task, build a dynamic leaderboard for LMs | * Instead of a shared task, build a dynamic leaderboard for LMs | ||
wg3/wg3_meeting_2023-03-17.txt · Last modified: 2023/09/20 10:28 by joakim.nivre