Video Retrieval in Sign Language Videos : How to Model and Compare Signs?

Lefebvre-Albaret, François | Dalle, Patrice

Volume:: Proceedings of the 7th International Conference on Language Resources and Evaluation (LREC 2010)
Venue:: Valletta, Malta
Date:: 17 to 23 May 2010
Pages:: 3049–3054
Publisher:: European Language Resources Association (ELRA)
License:: CC BY-NC
ACL ID:: L10-1116
ISBN:: 978-2-9517408-6-0

Content Categories

Languages:: French Sign Language

Abstract

This paper deals with the problem of finding sign occurrences in a sign language (SL) video. It begins with an analysis of sign models and the way they can take into account the sign variability. Then, we review the most popular technics dedicated to automatic sign language processing and we focus on their adaptation to model sign variability. We present a new method to provide a parametric description of the sign as a set of continuous and discrete parameters. Signs are classified according to there categories (ballistic movements, circles ...), the symmetry between the hand movements, hand absolute and relative locations. Membership grades to sign categories and continuous parameter comparisons can be combined to estimate the similarity between two signs. We set out our system and we evaluate how much time can be saved when looking for a sign in a french sign language video. By now, our formalism only uses hand 2D locations, we finally discuss about the way of integrating other parameters as hand shape or facial expression in our framework.

Document Download

Paper PDF BibTeX File + Abstract

Cite as

Citation in ACL Citation Format

François Lefebvre-Albaret, Patrice Dalle. 2010. Video Retrieval in Sign Language Videos : How to Model and Compare Signs?. In Proceedings of the 7th International Conference on Language Resources and Evaluation (LREC 2010), pages 3049–3054, Valletta, Malta. European Language Resources Association (ELRA).

BibTeX Export

@inproceedings{lefebvre-albaret-dalle-2010-video:lrec,
  author    = {Lefebvre-Albaret, Fran{\c c}ois and Dalle, Patrice},
  title     = {Video Retrieval in Sign Language Videos : How to Model and Compare Signs?},
  pages     = {3049--3054},
  editor    = {Calzolari, Nicoletta and Choukri, Khalid and Maegaard, Bente and Mariani, Joseph and Odijk, Jan and Piperidis, Stelios and Rosner, Mike and Tapias, Daniel},
  booktitle = {7th International Conference on Language Resources and Evaluation ({LREC} 2010)},
  publisher = {{European Language Resources Association (ELRA)}},
  address   = {Valletta, Malta},
  day       = {17--23},
  month     = may,
  year      = {2010},
  isbn      = {978-2-9517408-6-0},
  language  = {english},
  url       = {http://www.lrec-conf.org/proceedings/lrec2010/pdf/176_Paper.pdf}
}