Spanish sign language interpreter for mexican linguistics

Authors

  • Francisco Javier Juan Barragán Instituto Tecnológico Superior de Chapala, Chapala, Jalisco, ZP: 45900, México
  • José Arturo Pérez Grana Instituto Tecnológico Superior de Chapala, Chapala, Jalisco, ZP: 45900, México
  • Francisco Cervantes Instituto Tecnológico Superior de Chapala, Chapala, Jalisco, ZP: 45900, México
  • Morris Schwarzblat y Katz Instituto Tecnológico Superior de Chapala, Chapala, Jalisco, ZP: 45900, México
  • María Guadalupe Olide Márquez Instituto Tecnológico Superior de Chapala, Chapala, Jalisco, ZP: 45900, México
  • Ana Paola Pérez Sánchez Instituto Tecnológico Superior de Chapala, Chapala, Jalisco, ZP: 45900, México

Keywords:

Mexican Sign Language (MSL), Spoken language translation, Sign animation, Sintactic algortithm

Abstract

We present here the first visual interface for a Mexican Spanish Sign Language translator on its first development stage: sign-writing recognition. The software was developed for the unique characteristics of Mexican linguistics and was designed in order to use sentences or a sequence of signs in sign-writing system which are decoded by the program and converted into a series of images with movement that correspond to the Mexican sign language system. Using a lexical, syntactic and semantic algorithms plus free software such as APIs's from Java, video converter software, data base manager like MySQL, Postgres and SQlite, was possible to read and interpret the rich and complex Mexican language. Our application for visual interface showed to be capable of reading and reconstruct each sentence used for the interpreter and translate it into a high de finition video. The average time of video display vs number of sentences to interpret, probed to be in linear relation with an average time of two seconds per sentence. The software has over come the problem of homonym words frequently used in Spanish language and verb tense relation for each sentence, special symbols such as #, %, $, etc. are still not recognized into the software

Downloads

Download data is not yet available.

References

[1] Aranda., B. E., 2008. La vulnera ión de los derechos humanos de las personas Sordas en México. Comisión Nacional de los Derechos Humanos, CNDH.
[2] R. Barra, R. Córdoba, L.F. Haroa, F. Fernándeza, J. Ferreirosa, J.M. Lucasa, J. Macías- Guarasab, J.M. Monteroa and J.M. Pardoa, Speech to sign language translation system for Spanish, Aplied Soft Computing, 2008.
[3] Comparán, J. J., 1999. Lengua Española I. México: AMATE. Discapacidades, E. C. La sordera y la pérdida de la capacidad auditiva., http://www.sitiodesordos.com.ar/sordera.htm.
[4] Ding Lilia, Modelling and recognition of the linguisti components in American Sign Language,
Aplied Soft Computing, 2008, 421, 105.
[5] Donés, R., & Ortíz, C., 2005, XXXV SIMPOSIO INTERNACIONAL DE LA SEL: http://www3.unileon.es/dp/dfh/SEL/actas.htm.
[6] J. Earley, An Efficient Context-Free Parsing Algorithm, PhD tesis, University of California, Berkeley, California, 1970, pp. 94-102, http://www2. cs.cmu.edu/afs/cs.cmu.edu/project/cmt-55/lti/Courses/711/Class-notes/p94-earley.pdf.
[7] El Universal. 2006: http://www.eluniversal.com.mx/artiulos/30484.html.
[8] Estrada, B., 2008, Sordos: www.sordos.org.mx/articulo.do.
[9] Galicia, S. N., 2000, Instituto Politécnico Nacional Centro de Investigación en Computación Laboratorio de Lenguaje Natural, Análisis sintáctico: http://www.gelbukh. om/Tesis/Sofia/tesisfinal.htm.
[10] García, J. R., & Giner, B., 2007, Pearson, Prentice Hall.
[11] Leybon I. J, Ramirez B. M.R., Picazo T. V., Photo-Electric Sensor Applied to Hand Fingers Movement, Computa ión y Sistemas, 2006, 10, 556.
[12] Lodares, J. R., Aplicaciones Lexemáticas a la Enseñanza Del Español, 2009, Clarín, Revista de Nueva Literatura, 78.
[13] J. M. Montero M., Desarrollo de un Entorno para el Análisis Sintá ti o de una Lengua Natural, Universidad Politécnica de Madrid, España, 2004, http://lorien.die.upm.es/juancho/pfcs/JMMM/pfjmmm.pdf.
[14] Nuno, R. (1998). Correlatos neurofisiológicos del lenguaje de señas en el nino sordo. Proyecto de Investigación.
[15] J.M. Pardoa, J. Ferreirosa, V. Samaa, R. Barra-Chicotea, J.M. Lucasa, D. Sánchezb and A. Garcíab Spoken Spanish generation from sign language, 2009, Aplied Soft Computing, 123.
[16] Dr.Sami M.Halawani, Arabi Sign Language Translation System On Mobile Devices, International Journal of Computer Science and Network Security, 2008, 8, 1.
[17] Suphattharachai C., Towards the Development of Speaker-Dependent and Speaker-Independent
Markov Model-Based Thai Speech Synthesis, 2009, Journal of Computer Science, 5, 905.

Downloads

Published

2013-04-01

How to Cite

Juan Barragán, F. J., Pérez Grana, J. A., Cervantes, F., Schwarzblat y Katz, M., Olide Márquez, M. G., & Pérez Sánchez, A. P. (2013). Spanish sign language interpreter for mexican linguistics. Journal of Computer Science and Technology, 13(01), p. 32–37. Retrieved from https://journal.info.unlp.edu.ar/JCST/article/view/641

Issue

Section

Original Articles