sign-lang@LREC Anthology


PeruSIL: A Framework to Build a Continuous Peruvian Sign Language Interpretation Dataset

Bejarano, Gissella Maria | Huamani-Malca, Joe | Cerna-Herrera, Francisco | Alva-Manchego, Fernando | Rivas, Pablo


Volume:
Proceedings of the LREC2022 10th Workshop on the Representation and Processing of Sign Languages: Multilingual Sign Language Resources
Venue:
Marseille, France
Date:
25 June 2022
Pages:
1–8
Publisher:
European Language Resources Association (ELRA)
License:
CC BY-NC 4.0
sign-lang ID:
22013
ACL ID:
2022.signlang-1.1
ISBN:
979-10-95546-86-3

Abstract

Video-based datasets for Continuous Sign Language are scarce due to the challenging task of recording videos from native signers and the reduced number of people who can annotate sign language. COVID-19 has evidenced the key role of sign language interpreters in delivering nationwide health messages to deaf communities. In this paper, we present a framework for creating a multi-modal sign language interpretation dataset based on videos and we use it to create the first dataset for Peruvian Sign Language (LSP) interpretation annotated by hearing volunteers who have intermediate knowledge of PSL guided by the video audio. We rely on hearing people to produce a first version of the annotations, which should be reviewed by native signers in the future. Our contributions: i) we design a framework to annotate a sign Language dataset; ii) we release the first annotated LSP multi-modal interpretation dataset (AEC); iii) we evaluate the annotation done by hearing people by training a sign language recognition model. Our model reaches up to 80.3% of accuracy among a minimum of five classes (signs) AEC dataset, and 52.4% in a second dataset. Nevertheless, analysis by subject in the second dataset show variations worth to discuss.

Document Download

Paper PDF BibTeX File BibTeX File w/Abstract

BibTeX Export

@inproceedings{bejarano:22013:sign-lang:lrec,
  author    = {Bejarano, Gissella Maria and Huamani-Malca, Joe and Cerna-Herrera, Francisco and Alva-Manchego, Fernando and Rivas, Pablo},
  title     = {{PeruSIL}: A Framework to Build a Continuous {Peruvian} {Sign} {Language} Interpretation Dataset},
  pages     = {1--8},
  editor    = {Efthimiou, Eleni and Fotinea, Stavroula-Evita and Hanke, Thomas and Hochgesang, Julie A. and Kristoffersen, Jette and Mesch, Johanna and Schulder, Marc},
  booktitle = {Proceedings of the {LREC2022} 10th Workshop on the Representation and Processing of Sign Languages: Multilingual Sign Language Resources},
  maintitle = {13th International Conference on Language Resources and Evaluation ({LREC} 2022)},
  publisher = {{European Language Resources Association (ELRA)}},
  address   = {Marseille, France},
  day       = {25},
  month     = jun,
  year      = {2022},
  isbn      = {979-10-95546-86-3},
  language  = {english},
  url       = {https://www.sign-lang.uni-hamburg.de/lrec/pub/22013.pdf}
}
Something missing or wrong?