Bilingual dictionaries present several challenges, especially for sign languages and oral languages, where multimodality plays a role. We deployed and tested the first bilingual Peruvian Sign Language (LSP) – Spanish Online Dictionary. The first feature allows the user to introduce a text and receive as a result a list of videos whose glosses are related to the input text or Spanish word. The second feature allows the user to sign in front of the camera and shows the five most probable Spanish translations based on the similarity between the input sign and gloss-labeled sign videos used to train a machine learning model. These features are constructed in a design and architecture that differentiates among the coincidence for the Spanish text searched, the sign gloss, and Spanish translation. We explain in depth how these concepts or database columns impact the search. Similarly, we share the challenges of deploying a real-world machine learning model for isolated sign language recognition through Amazon Web Services (AWS).
Autor(es):HUAMANI-MALCA, Joe
RODRÍGUEZ MONDOÑEDO, Miguel
CERNA-HERRERA, Francisco
BEJARANO, Gissella
VÁSQUEZ ROQUE, Carlos
RAMOS CANTU, Cesar Augusto
OPORTO PÉREZ, Sabina
Año: 2024
Título de la revista: Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Ciudad: Torino, Italia
Página inicial - Página final: 10316–10323
Url: https://aclanthology.org/2024.lrec-main.901/