Bilingual dictionaries present several challenges, especially for sign languages and oral languages, where multimodality plays a role. We deployed and tested the first bilingual Peruvian Sign Language (LSP) - Spanish Online Dictionary. The first feature allows the user to introduce a text and receive as a result a list of videos whose glosses are related to the input text or Spanish word. The second feature allows the user to sign in front of the camera and shows the five most probable Spanish translations based on the similarity between the input sign and gloss-labeled sign videos used to train a machine learning model. These features are constructed in a design and architecture that differentiates among the coincidence for the Spanish text searched, the sign gloss, and Spanish translation. We explain in depth how these concepts or database columns impact the search. Similarly, we share the challenges of deploying a real-world machine learning model for isolated sign language recognition through Amazon Web Services (AWS).
@inproceedings{huamani-malca-etal-2024-lessons:lrec,
author = {Huamani-Malca, Joe and Rodr{\'i}guez Mondo{\~n}edo, Miguel and Cerna-Herrera, Francisco and Bejarano, Gissella and V{\'a}squez Roque, Carlos and Ramos Cantu, Cesar Augusto and Oporto P{\'e}rez, Sabina},
title = {Lessons from Deploying the First Bilingual Peruvian Sign Language - Spanish Online Dictionary},
pages = {10316--10323},
editor = {Calzolari, Nicoletta and Kan, Min-Yen and Hoste, Veronique and Lenci, Alessandro and Sakti, Sakriani and Xue, Nianwen},
booktitle = {2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation ({LREC-COLING} 2024)},
publisher = {{ELRA Language Resources Association (ELRA) and the International Committee on Computational Linguistics (ICCL)}},
address = {Torino, Italy},
day = {20--25},
month = may,
year = {2024},
isbn = {978-2-493814-10-4},
language = {english},
url = {https://aclanthology.org/2024.lrec-main.901}
}