Leveraging Text-side Augmentation For Sign Language Translation
Fabre, Diandra 
| Lascar, Julie | Halbout, Julie | Vartampetian, Markarit
- Volume:
- Proceedings of the LREC2026 12th Workshop on the Representation and Processing of Sign Languages: Language in Motion
- Venue:
- Palma, Mallorca, Spain
- Date:
- 16 May 2026
- Pages:
- 129–139
- Publisher:
- European Language Resources Association (ELRA)
- Licence:
- CC BY-NC 4.0
- sign-lang ID:
- 26016
- ISBN:
- 978-2-493814-82-1
Abstract
Sign language translation faces significant challenges due to the scarcity of annotated data and the inherent complexity of sign languages. This paper presents a method to improve sign-to-text translation models by augmenting data on the text side. We conduct experiments using two state-of-the-art models on two publicly available datasets: PHOENIX-2014T for German Sign Language and Mediapi-RGB for French Sign Language. Our main contributions are : (1) augmenting the training sets of both datasets on the text side using a generative model, (2) evaluating the impact of paraphrasing on BLEU and BLEURT scores, and (3) analyzing the impact of paraphrasing on translation outputs. We observed a significant improvement in translation for both languages. This suggests that adding variability to the training dataset through paraphrasing can lead to better generalization of the models. These results are comparable to state-of-the-art methods that use more complex approaches, such as Visual-Language fine-tuning, to improve translation.Document Download
Paper PDF BibTeX File + Abstract
Cite as
Citation in ACL Citation Format
Diandra Fabre, Julie Lascar, Julie Halbout, Markarit Vartampetian. 2026. Leveraging Text-side Augmentation For Sign Language Translation. In Proceedings of the LREC2026 12th Workshop on the Representation and Processing of Sign Languages: Language in Motion, pages 129–139, Palma, Mallorca, Spain. European Language Resources Association (ELRA).BibTeX Export
@inproceedings{fabre:26016:sign-lang:lrec,
author = {Fabre, Diandra and Lascar, Julie and Halbout, Julie and Vartampetian, Markarit},
title = {Leveraging Text-side Augmentation For Sign Language Translation},
pages = {129--139},
editor = {Efthimiou, Eleni and Fotinea, Stavroula-Evita and Hanke, Thomas and Hochgesang, Julie A. and Mesch, Johanna and Schulder, Marc},
booktitle = {Proceedings of the {LREC2026} 12th Workshop on the Representation and Processing of Sign Languages: Language in Motion},
maintitle = {15th International Conference on Language Resources and Evaluation ({LREC} 2026)},
publisher = {{European Language Resources Association (ELRA)}},
address = {Palma, Mallorca, Spain},
day = {16},
month = may,
year = {2026},
isbn = {978-2-493814-82-1},
language = {english},
url = {https://www.sign-lang.uni-hamburg.de/lrec/pub/26016.html}
}