sign-lang@LREC Anthology

Evaluation of Manual and Non-manual Components for Sign Language Recognition

Mukushev, Medet | Sabyrov, Arman | Imashev, Alfarabi | Koishybay, Kenessary | Kimmelman, Vadim | Sandygulova, Anara

Volume:: Proceedings of the 12th International Conference on Language Resources and Evaluation (LREC 2020)
Venue:: Marseille, France
Date:: 11 to 16 May 2020
Pages:: 6073–6078
Publisher:: European Language Resources Association (ELRA)
License:: CC BY-NC 4.0
ACL ID:: 2020.lrec-1.745
ISBN:: 979-10-95546-34-4

Content Categories

Projects:: K-SLARS
Languages:: Kazakh-Russian Sign Language
Corpora:: K-RSL Dataset

Abstract

The motivation behind this work lies in the need to differentiate between similar signs that differ in non-manual components present in any sign. To this end, we recorded full sentences signed by five native signers and extracted 5200 isolated sign samples of twenty frequently used signs in Kazakh-Russian Sign Language (K-RSL), which have similar manual components but differ in non-manual components (i.e. facial expressions, eyebrow height, mouth, and head orientation). We conducted a series of evaluations in order to investigate whether non-manual components would improve sign's recognition accuracy. Among standard machine learning approaches, Logistic Regression produced the best results, 78.2% of accuracy for dataset with 20 signs and 77.9% of accuracy for dataset with 2 classes (statement vs question). Dataset can be downloaded from the following website: https://krslproject.github.io/krsl20/

Document Download

Paper PDF BibTeX File + Abstract

BibTeX Export

@inproceedings{mukushev-etal-2020-evaluation:lrec,
  author    = {Mukushev, Medet and Sabyrov, Arman and Imashev, Alfarabi and Koishybay, Kenessary and Kimmelman, Vadim and Sandygulova, Anara},
  title     = {Evaluation of Manual and Non-manual Components for Sign Language Recognition},
  pages     = {6073--6078},
  editor    = {Calzolari, Nicoletta and Fr{\'e}d{\'e}ric B{\'e}chet and Blache, Philippe and Choukri, Khalid and Cieri, Christopher and Declerck, Thierry and Goggi, Sara and Isahara, Hitoshi and Maegaard, Bente and Mariani, Joseph and Mazo, H{\'e}l{\`e}ne and Moreno, Asuncion and Odijk, Jan and Piperidis, Stelios},
  booktitle = {12th International Conference on Language Resources and Evaluation ({LREC} 2020)},
  publisher = {{European Language Resources Association (ELRA)}},
  address   = {Marseille, France},
  day       = {11--16},
  month     = may,
  year      = {2020},
  isbn      = {979-10-95546-34-4},
  language  = {english},
  url       = {https://aclanthology.org/2020.lrec-1.745}
}

Something missing or wrong?