sign-lang@LREC Anthology

Detection of Major ASL Sign Types in Continuous Signing For ASL Recognition

Yanovich, Polina | Neidle, Carol | Metaxas, Dimitris


Volume:
Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC 2016)
Venue:
Portorož, Slovenia
Date:
23 to 28 May 2016
Pages:
3067–3073
Publisher:
European Language Resources Association (ELRA)
License:
CC BY-NC 4.0
ACL ID:
L16-1490
ISBN:
978-2-9517408-9-1

Content Categories

Languages:
American Sign Language
Corpora:
NCSLGR

Abstract

In American Sign Language (ASL) as well as other signed languages, different classes of signs (e.g., lexical signs, fingerspelled signs, and classifier constructions) have different internal structural properties. Continuous sign recognition accuracy can be improved through use of distinct recognition strategies, as well as different training datasets, for each class of signs. For these strategies to be applied, continuous signing video needs to be segmented into parts corresponding to particular classes of signs. In this paper we present a multiple instance learning-based segmentation system that accurately labels 91.27% of the video frames of 500 continuous utterances (including 7 different subjects) from the publicly accessible NCSLGR corpus (Neidle and Vogler, 2012). The system uses novel feature descriptors derived from both motion and shape statistics of the regions of high local motion. The system does not require a hand tracker.

Document Download

Paper PDF BibTeX File+ Abstract

BibTeX Export

@inproceedings{yanovich-etal-2016-detection:lrec,
  author    = {Yanovich, Polina and Neidle, Carol and Metaxas, Dimitris},
  title     = {Detection of Major {ASL} Sign Types in Continuous Signing For {ASL} Recognition},
  pages     = {3067--3073},
  editor    = {Calzolari, Nicoletta and Choukri, Khalid and Declerck, Thierry and Goggi, Sara and Grobelnik, Marko and Maegaard, Bente and Mariani, Joseph and Mazo, H{\'e}l{\`e}ne and Moreno, Asuncion and Odijk, Jan and Piperidis, Stelios},
  booktitle = {10th International Conference on Language Resources and Evaluation ({LREC} 2016)},
  publisher = {{European Language Resources Association (ELRA)}},
  address   = {Portoro{\v z}, Slovenia},
  day       = {23--28},
  month     = may,
  year      = {2016},
  isbn      = {978-2-9517408-9-1},
  language  = {english},
  url       = {https://aclanthology.org/L16-1490}
}
Something missing or wrong?