sign-lang@LREC Anthology

Weakly supervised automatic transcription of mouthings for gloss-based sign language corpora

Koller, Oscar | Ney, Hermann | Bowden, Richard


Volume:
Proceedings of the LREC2014 6th Workshop on the Representation and Processing of Sign Languages: Beyond the Manual Channel
Venue:
Reykjavik, Iceland
Date:
31 May 2014
Pages:
89–94
Publisher:
European Language Resources Association (ELRA)
License:
CC BY-NC 4.0
sign-lang ID:
14031

Content Categories

Languages:
German Sign Language
Corpora:
RWTH-PHOENIX-Weather

Abstract

In this work we propose a method to automatically annotate mouthings in sign language corpora, requiring no more than a simple gloss annotation and a source of weak supervision, such as automatic speech transcripts. For a long time, research on automatic recognition of sign language has focused on the manual components. However, a full understanding of sign language is not possible without exploring its remaining parameters. Mouthings provide important information to disambiguate homophones with respect to the manuals. Nevertheless most corpora for pattern recognition purposes are lacking any mouthing annotations. To our knowledge no previous work exists that automatically annotates mouthings in the context of sign language. Our method produces a frame error rate of 39% for a single signer.

Document Download

Paper PDF BibTeX File+ Abstract

BibTeX Export

@inproceedings{koller:14031:sign-lang:lrec,
  author    = {Koller, Oscar and Ney, Hermann and Bowden, Richard},
  title     = {Weakly supervised automatic transcription of mouthings for gloss-based sign language corpora},
  pages     = {89--94},
  editor    = {Crasborn, Onno and Efthimiou, Eleni and Fotinea, Stavroula-Evita and Hanke, Thomas and Kristoffersen, Jette and Mesch, Johanna},
  booktitle = {Proceedings of the {LREC2014} 6th Workshop on the Representation and Processing of Sign Languages: Beyond the Manual Channel},
  maintitle = {9th International Conference on Language Resources and Evaluation ({LREC} 2014)},
  publisher = {{European Language Resources Association (ELRA)}},
  address   = {Reykjavik, Iceland},
  day       = {31},
  month     = may,
  year      = {2014},
  language  = {english},
  url       = {https://www.sign-lang.uni-hamburg.de/lrec/pub/14031.pdf}
}
Something missing or wrong?