The fourth WG meeting (online) was mainly devoted to reports from two subgroups, followed by discussion.

Multilingual Evaluation Campaigns

Omer Goldman made a progress report on the morpho-syntactic analyso-parsing task and presented a data definition document that will be shared with WG members shortly. Discussion points:

How do the representations relate to current UD guidelines? They contradict UD guidelines in some respects (notably with respect to words as central units) but should remain compatible with them in most other respects.

What tools can be used to create the representations? Udapi was recommended as a good tool for manipulating UD resources.

What evaluation metrics should be used? MLAS is a metric used in the CoNLL shared tasks that includes both morphology and syntax, but it may have to be adapted.

Defining Multilingual and Cross-Lingual Tools

Adriana Pagano and Ilan Kernerman presented plans for a subgroup on defining multilingual and cross-lingual tools in the context of UniDive

. Discussion points:

How does this task relate to the documentation task?

List of Participants (from Zoom)

Joakim Nivre