Sign language recognition (SLR) involves identifying the form and meaning of isolated signs or sequences of signs. To our knowledge, the combination of SLR and sign language assessment is novel. The goal of an ongoing three-year project in Switzerland is to pioneer an assessment system for lexical signs of Swiss German Sign Language (Deutschschweizerische Geba ̈rdensprache, DSGS) that relies on SLR. The assessment system aims to give adult L2 learners of DSGS feedback on the correctness of the manual parameters (handshape, hand position, location, and movement) of isolated signs they produce. In its initial version, the system will include automatic feedback for a subset of a DSGS vocabulary production test consisting of 100 lexical items. To provide the SLR component of the assessment system with sufficient training samples, a large-scale dataset containing videotaped repeated productions of the 100 items of the vocabulary test with associated transcriptions and annotations was created, consisting of data from 11 adult L1 signers and 19 adult L2 learners of DSGS. This paper introduces the dataset, which will be made available to the research community.
@inproceedings{ebling-etal-2018-smile:lrec,
author = {Ebling, Sarah and Camg{\"o}z, Necati Cihan and Boyes Braem, Penny and Tissi, Katja and Sidler-Miserez, Sandra and Stoll, Stephanie and Hadfield, Simon and Haug, Tobias and Bowden, Richard and Tornay, Sandrine and Razavi, Marzieh and Magimai Doss, Mathew},
title = {{SMILE} {S}wiss {G}erman Sign Language Dataset},
pages = {4221--4229},
editor = {Calzolari, Nicoletta and Choukri, Khalid and Cieri, Christopher and Declerck, Thierry and Goggi, Sara and Hasida, Koiti and Isahara, Hitoshi and Maegaard, Bente and Mariani, Joseph and Mazo, H{\'e}l{\`e}ne and Moreno, Asuncion and Odijk, Jan and Piperidis, Stelios and Tokunaga, Takenobu},
booktitle = {11th International Conference on Language Resources and Evaluation ({LREC} 2018)},
publisher = {{European Language Resources Association (ELRA)}},
address = {Miyazaki, Japan},
day = {7--12},
month = may,
year = {2018},
isbn = {979-10-95546-00-9},
language = {english},
url = {https://aclanthology.org/L18-1666}
}