Automatic Alignment of HamNoSys Subunits for Continuous Sign Language Recognition

Koller, Oscar | Ney, Hermann | Bowden, Richard

Volume:: Proceedings of the LREC2016 7th Workshop on the Representation and Processing of Sign Languages: Corpus Mining
Venue:: Portorož, Slovenia
Date:: 28 May 2016
Pages:: 121–128
Publisher:: European Language Resources Association (ELRA)
License:: CC BY-NC 4.0
sign-lang ID:: 16036

Content Categories

Languages:: German Sign Language, Swiss-German Sign Language, Danish Sign Language
Corpora:: RWTH-PHOENIX-Weather 2014
Dictionaries:: DSGS Lexicon, DTS Dictionary
Writing Systems:: HamNoSys

Abstract

This work presents our recent advances in the field of automatic processing of sign language corpora targeting continuous sign language recognition. We demonstrate how generic annotations at the articulator level, such as HamNoSys, can be exploited to learn subunit classifiers. Specifically, we explore cross-language-subunits of the hand orientation modality, which are trained on isolated signs of publicly available lexicon data sets for Swiss German and Danish sign language and are applied to continuous sign language recognition of the challenging RWTH-PHOENIX-Weather corpus featuring German sign language. We observe a significant reduction in word error rate using this method.

Document Download

Paper PDF BibTeX File + Abstract

Cite as

Citation in ACL Citation Format

Oscar Koller, Hermann Ney, Richard Bowden. 2016. Automatic Alignment of HamNoSys Subunits for Continuous Sign Language Recognition. In Proceedings of the LREC2016 7th Workshop on the Representation and Processing of Sign Languages: Corpus Mining, pages 121–128, Portorož, Slovenia. European Language Resources Association (ELRA).

BibTeX Export

@inproceedings{koller:16036:sign-lang:lrec,
  author    = {Koller, Oscar and Ney, Hermann and Bowden, Richard},
  title     = {Automatic Alignment of {HamNoSys} Subunits for Continuous Sign Language Recognition},
  pages     = {121--128},
  editor    = {Efthimiou, Eleni and Fotinea, Stavroula-Evita and Hanke, Thomas and Hochgesang, Julie A. and Kristoffersen, Jette and Mesch, Johanna},
  booktitle = {Proceedings of the {LREC2016} 7th Workshop on the Representation and Processing of Sign Languages: Corpus Mining},
  maintitle = {10th International Conference on Language Resources and Evaluation ({LREC} 2016)},
  publisher = {{European Language Resources Association (ELRA)}},
  address   = {Portoro{\v z}, Slovenia},
  day       = {28},
  month     = may,
  year      = {2016},
  language  = {english},
  url       = {https://www.sign-lang.uni-hamburg.de/lrec/pub/16036.pdf}
}