LREC logo

11th Workshop on the Representation and Processing of Sign Languages:

Evaluation of Sign Language Resources


Submissions are invited for a full day workshop on sign language resources, to take place at the last day of the 2024 LREC-COLING conference, i.e. on May 25, 2024.

During the past years, a number of large-scale sign language corpus projects have started. Some have already been completed, but many more projects are about to start. At the same time, sign language technologies are maturing and are promising to support the time-consuming basic annotation. The workshop aims at bringing together those researchers who already work with multimodal sign language corpora (and those who see the need for empirical underpinnings of their current research) with those who develop sign language technologies. It provides the platform to compare competing approaches.

As sign language resource technologies build to a large extent on methodologies and tools used in the language resource community in general, but add very specific perspectives (e.g. no writing system established, use of video as data source) and works with a different modality of human language, sign language research is able to feed back to the language resource community at large. At the same time, as the raw data are in the visual domain, the field naturally bridges into Computer Vision. Thus, researchers use Machine Learning methods on both visual and linguistic data.

We are also pleased to confirm that the workshop will be a hybrid event. Similar to the 2022 workshop, participants will be given access to an online text chat before and during the event for online participants to present their work as well as for discussion of all workshop contributions. On-stage presentations will be live streamed (including International Sign/English interpretation) with opportunity for questions from online and on-site participants. The live poster sessions will be held on-site only, but posters will be made available online for discussion via text chat.

We invite submissions of papers to be presented either on stage (20 minutes plus 10 minutes discussion) or as posters (with or without demonstrations) or remotely (poster pdf plus text chat) on the following topics:

2024 Special Topic: Evaluation of Sign Language Resources

With the field maturing, it becomes an urgent issue to assess the quality of sign language resources for a large variety of tasks. We invite contributions on both automatic and human-based evaluation procedures for all kinds of sign language resources and tools.

General Issues on Sign Language Corpora and Tools

  • Avatar technology as a tool in sign language corpora and corpus data feeding into advances in avatar technology
  • Experiences in building sign language corpora
  • Elicitation methodology appropriate for corpus collection
  • Proposals for standards for linguistic annotation or for metadata descriptions
  • Experiences from linguistic research using corpora
  • Use of (parallel) corpora and lexicons in translation studies and machine translation
  • Language documentation and long-term accessibility for sign language data
  • Annotation and visualization tools
  • Linking corpora and lexicons and integrated presentation of corpus and dictionary contents
  • “Internet as a corpus” for sign languages
  • Sign language corpus mining
  • Crowd and community sourcing for corpus work
  • Multi-lingual sign language resources and connecting sign language resources to language resources for spoken languages
  • FAIR, CARE and OpenScience for sign language data

In the tradition of LREC, oral/signed presentations and poster presentations (with or without demonstrations) have equal status, and authors are encouraged to suggest the presentation format best suited to communicate their ideas. Papers of all accepted submissions to this workshop will be published as workshop proceedings published on the conference website – independent of whether you have a poster or an oral/signed presentation.

ATTENTION Please note that you are expected to submit the full paper, not an extended abstract as for earlier workshops!

Please submit your paper through the LREC-COLING START system not later than February 29, 2024 (any time zone), indicating whether you prefer an oral/signed, a poster presentation or a poster presentation with demo.

In order to make the hybrid mode most effective, we kindly ask not only remote presenters, but all presenters to make their posters/slides and additional materials (such as demo videos) available to all participants. Details how to upload will be communicated later.