Universality, diversity and idiosyncrasy
in language technology
CA21167 COST Action

User Tools

Site Tools

Trace: • wg1
wg1:wg1

Table of Contents

Working Group 1: Corpus Annotation

Workplan

Annotated corpora constitute the Action's major operational tools for NLP-applied universality. Therefore, WG1 will be dedicated to the following activities:

  1. Studies and community discussions in language typology and language universals at the level of morphology, syntax and semantics, with special attention paid to idiosyncrasy at all these levels;
  2. Unification and enhancement of cross-lingual annotation guidelines for morpho-syntax and MWEs:
    • defining the division of labour between morpho-syntactic and semantic annotation,
    • addressing hard or weakly covered syntactic phenomena (syntactically irregular structures, relative clauses, coordination, pronoun inclusivity, etc.),
    • covering new MWE categories (nominal, adjectival and functional MWEs),
    • paving the way for unified annotation guidelines for idiosyncratic constructions;
  3. Coordinate the development and maintenance of centralized software for universality-based corpus construction:
    • online spaces for community discussion and editing annotation guidelines,
    • tools for automatic pre-annotation, annotation transfer and manual annotation of corpora,
    • tools for corpus merging, validation, curation, statistics, conversion and release. The software development itself will be funded at national levels;
  4. Defining file formats for corpora annotated according to the unified guidelines;
  5. Construction of annotated corpora:
    • adapting the existing corpora to the enhanced guidelines,
    • creating new annotated corpora following the enhanced guidelines.

Members and organisation

  • List of current WG1 members
  • Activities are currently structured around four primary WG1 tasks detailed below, but proposals for new activities are always welcome.

Upcoming meetings

  • WG Meeting 8 (online) - 11 April 2024, 09:00 CEST
  • WG Meeting 9 (online) - 11 June 2024, 13:30 CEST

Minutes of past meetings

  • WG1 Meeting 7 (Naples, Italy) - 7 February 2024: co-located with the 2nd General Meeting in Naples on 8-9 Feb 2024, [short report]
  • WG1 Meeting 6 (online) - 17 January 2024: Presentation of the WG1 activities in Naples [minutes]
  • WG1 Meeting 5 (online) - 20 December 2023: Updates on WG1 tasks and discussion of the activities proposed for Naples [minutes]
  • WG1 Meeting 4 (online) - 27 November 2023: Updates on WG1 wiki, WG1 task activities and general [minutes]
  • WG1 Meeting 3 (online) - 25 October 2023: Updates on WG1 tasks activities [minutes]
  • WG1 Meeting 2 (online) - 13 September 2023: launching WG1 tasks [minutes]
  • WG1 Meeting 1 (Paris-Saclay University, France) - 16-17 March 2023: brainstorming topics and slides - co-located with UniDive 1st general meeting

WG1 Tasks

  • Task 1.1: Linguistic typology and multilingual corpus annotation
    • Leaders / Contacts: André Coneglian, A. Seza Doğröuz
    • Objectives: Discuss how Linguistic Typology, Corpus Annotation and Universal Dependencies can be brought into mutual relevance. More specifically, discuss how Linguistic Typology and Corpus Annotation can be explored to provide insights into the development of treebanks for new languages not in the UD database.
    • Work plan:
      1. Determine ways in which linguistic typology can help in the trade-off between universality and language specific phenomena in corpus annotation (Systematic overview of problematic (or difficult) phenomena for annotation (e.g., noun incorporation, and others) in order to evaluate what solutions what been proposed and whether or not unification is possible).
      2. Take into account less-resourced languages in corpus annotation so as to create new annotated corpora
      3. More broadly, assess how annotated treebanks (particularly UD treebanks) can figure in typological research
    • How can I contribute: <TBA>
    • Documents / Links:
  • Task 1.2 on MWE annotation guidelines and UD-PARSEME unification
    • Leaders / Contacts: Agata Savary, Voula Giouli, Stella Markanotatou, Sara Stymne, Carlos Ramisch
    • Objectives: Model and annotate multiword expressions in a way which is unified across many languages. Make UD and PARSEME initiatives converge in this respect.
    • Workplan: After performing pilot annotation based on the draft guidelines for nominal MWEs during WG1 Day in Naples, we are currently working on transforming the annotator feedback into Gitlab issue discussions. We plan to have a consolidated version of the guidelines for all MWEs (verbal, nominal, modifier, functional) ready by end of 2024, so as to conduct a large-scale annotation campaign in early 2025. The results will be used for organizing a shared task on automatic MWE identification.
    • How can I contribute: <TBA>
    • Documents / Links
  • Task 1.3: Extensions and updates to morphosyntactic annotation guidelines
  • Task 1.4: Sharing tools, formats, and infrastructure
    • Leaders / Contacts: Frantisek Forgac, Bruno Guillaume
    • Objectives: The general objective of the task is to improve the technical part of annotation activities, focusing on tools, file formats and storage infrastructures. We are currently focusing on two more spectific objectives:
      • Subtask A: Provide an overview of existing software and/or tools that support manual linguistic annotation
      • Subtask B: Evaluate the pros and cons of tabular formats (such as CoNNL-U) currently used in the UD and Parseme projects
    • Workplan:
      • Subtask A: The specific objective is to create a comparison table of available manual annotation tools morpho-syntactic and multiword expression annotations. A survey will be propose in the upcoming weeks, to collect feedback adn to produce the final version of the table.
      • Subtask B: Conduct a detailed analysis of the advantages and disadvantages of the tabular annotation formats, specifically CoNLL-U, as utilized in the Universal Dependencies (UD) and PARSEME projects. A first draft of an evolution of the formats currently used will be proposed for dicussions and for testing.
    • How can I contribute?
      • Join to the ongoing discussions on GitHub (links above)
      • Stay tuned for the call to complete the survey
      • Join the task co-leaders team
    • Documents

Training

Channels

Translations of this page:
  • en
wg1/wg1.txt · Last modified: 2024/05/07 10:41 by bruno.guillaume