AUTHORS: Dimitrios Kouremenos, Klimis Ntalianis, Andreas Stafylopatis
Download as PDF
ABSTRACT: One of the aims of Assistive Technologies is to help people with disabilities to communicate with others and to provide means of access to information. As an aid to Deaf people, in this work we present a novel prototype Rule Based Machine Translation (RBMT) system for the creation of large quality written Greek Sign Language (GSL) glossed corpora. In particular, the proposed RBMT system supports the professional translator of GSL to produce different kinds of GSL glossed corpus. Evaluation of the proposed scheme is carried out for the weather reports domain, were 20,284 tokens and 1,000 sentences have been produced. By using the BiLingual Evaluation Understudy (BLEU) metric score [32], our prototyped RBMT system achieves a relative score of 84% for 4-gram evaluation and 90% for 1-gram
KEYWORDS: - machine translation, Greek, Greek Sign Language, GSL, Deaf people communication, SiGML, 3D Avatar.
REFERENCES:
[1] Atserias, J., Casas, B., Comelles, E., Gonz M., Padró, L., Padr Syntactic and semantic services in an open source NLP library, 2006, pp. 48–55.
[2] Augustus, R., Ritchie, E., Stecker, S., official American Sign Language writing textbook, Los Angeles, CA ASLized, 2013.
[3] Baldassarri, S., RoyoRule-Based Translation System to Spanish Sign Language (LSE), In: New Computer Interaction. Springer, 11.
[4] Bangham, J., Cox, S., Elliott, R., Glauert, J., Marshall, I., Rankov, S., Wells, M., overview of ViSiCAST Speech Language processing disabled people, 2000.
[5] Bellugi, U., The signs of language University Press, 1979.
[6] Carpenter, B., The Logic of Structures; with Applications to Unification Grammars, Logic Programs and Constraint Resolution. Number 32 in Cambridge Tracts in Theoretical Computer Science, 1992.
[7] Carpenter, B., The logic of typed feature structures with applications to unification grammars, logic programs and constraint resolution. Cambridge University Press, 2005.
[8] Chandioux, J., METEO: an operational system for the translation of public weather forecasts. FBIS Seminar on Machine Translation, American Journal of Computational Linguistics, microfiche, 1976, pp. 46 27–36.
[9] Chandioux, J., Météo: 100 million words later.In: American Translators Association Conference, 1989, pp. 449–453.
[10] Efthimiou, E., Fotinea, S.-E., GSLC creation and annotation of a Greek sign language corpus for HCI. In: Universal Acess Human Computer Interaction. Coping Diversity. Springer, 2007, pp. 657–666.
[11] Efthimiou, E., Fotinea, S.-E., Dimou, A.-L., Goulas, T., Kouremenos, D., From grammarbased MT to post-processed SL representations. Universal Access in the Information Society, 2015, pp. 1–13.
[12] Efthimiou, E., Fotinea, S.-E., Hanke, T., Glauert, J., Bowden, R., Braffort, A., Collet, C., Maragos, P., Lefebvre-Albaret, F., Sign Language technologies and resources of the Dicta-Sign project. In: Proc. 5th Workshop Representation Processing Sign Languages Interactions Corpus Lexicon. LREC, 2012, pp. 23–27.
[13] Eleni Efthimiou, N.D. Stavroula-Evita Fotinea Theodore Goulas, Kouremenos., D., From Grammar Based MT to Post-processed SL Representations. In: Third International Symposium Sign Language Translation Avatar Technology, 2013.
[14] Elliott, R., Glauert, J., Jennings, V., Kennaway, J., An overview of the SiGML notation and SiGML Signing software system. In: Sign Language Processing Satellite Workshop Fourth International Conference Language Resources Evaluation, LREC, 2004, pp. 98– 104.
[15] Forcada, M.L., Ginest-Rosell, M., Nordfalk, J., O’Regan, J., Ortiz-Rojas, S., Pérez-Ortiz, J.A., Sánchez-Martnez, F., Ramrez-Sánchez, G., Tyers, F.M., Apertium: a free/open-source platform for rule-based machine translation. Machine translation, Springer 25, 2011, 127– 144.
[16] Fotinea, S.-E., Efthimiou, E., Kouremenos, D., Generating linguistic content for Greek to GSL. Proceedings of the HERCMA Conference. The 7th Hellenic European Conference on Computer Mathematics and its Applications, Athens, 2005.
[17] Hall, E.T., others, 1959. The silent language. Doubleday New York.
[18] Hanke, T., iLex-A tool for Sign Language Lexicography and Corpus Analysis. In: LREC, 2002.
[19] Hanke, T. & Popescu, H., EDC-22124 ESIGN / 27960 Deliverable D2.3: Intelligent Sign Editor, Available at: https://robertsmith2012.files.wordpress.com/201 2/10/esign-editor-d23.pdf, 2003, Accessed August 2013.
[20] Hoiting, N., Slobin, D.I., Transcription as a tool for understanding The Berkeley Transcription System for sign language research (BTS). In: Morgan, G. & B. Woll (Eds.) Directions in Sign Language Acquisition, 2002, pp. 55-76, Amsterdam Philadelphia John Benjamins.
[21] Huenerfauth, M., Generating American Sign Language classifier predicates for English-toASL machine translation. University of Pennsylvania, 2006.
[22] Huenerfauth, M.P., American sign language natural language generation and machine translation systems, Technical Report, Computer and Information Sciences, University of Pennsylvania. 2003. MS-CIS-03-32
[23] Hutchins, W.J., Somers, H.L., An introduction to machine translation. Academic Press London, 1992.
[24] Isabelle, P., Foster, G., Machine translation. Part I—Overview. Encyclopedia of Language and Linguistics. Elsevier 15, 2005, pp. 404– 422.
[25] Kanis, J., Müller, L., Automatic Czech–Sign Speech Translation. In: International Conference Text, Speech Dialogue. Springer, 2007, pp. 488–495.
[26] Kay, M., Functional unification grammar: A formalism for machine translation. In: Proceedings 10th International Conference Computational Linguistics 22nd annual meeting Association Computational Linguistics. Association for Computational Linguistics, 1984, pp. 75–78.
[27] Koehn, P., Hoang, H., Birch, A., CallisonBurch, C., Federico, M., Bertoldi, N., Cowan, B., Shen, W., Moran, C., Zens, R., others, Moses: Open source toolkit for statistical machine translation. In: Proceedings 45th annual meeting ACL interactive poster Demonstration sessions. Association for Computational Linguistics, 2007, pp. 177–180.
[28] Kouremenos, D., Fotinea, S.-E., Efthimiou, E., Ntalianis, K., A prototype Greek text to Greek Sign Language conversion system. Behaviour & Information Technology 29, 2010, pp. 467– 481.
[29] Kouremenos†, D., Fotinea, S.-E., Efthimiou, E., Ntalianis, K., A prototype Greek text to Greek Sign Language conversion system. Behaviour & Information Technology 29, 2010, pp. 467–481.
[30] Morrissey, S., Data-driven machine translation for sign languages. Ph.D. Thesis, Dublin City University, 2008.
[31] Neidle, C., Sclaroff, S., Athitsos, V., SignStream: A tool for linguistic and computer vision research on visual-gestural language data. Behavior Research Methods, Instruments & Computers 33, 2001, pp. 311–320.
[32] Papineni, K., Roukos, S., Ward, T., Zhu, W.-J., BLEU: A Method for Automatic Evaluation of Machine Translation. In: Proceedings 40th Annual Meeting Association Computational Linguistics, ACL’02. Association for Computational Linguistics, Philadelphia, Pennsylvania, 2002, 2003, pp. 311–318.
[33] Porta, Tejedor, J., A rule-based translation from written Spanish to Spanish Sign Language glosses. Computer : Speech : & : Language 28, 2014, pp. 788–811.
[34] Prillwitz, S., Kommunikation Gehörloser, H.Z. für Deutsche Gebärdensprache und, HamNoSys: version 2.0; Hamburg Notation System for Sign Languages; an introductory guide. Signum-Verlag, 1989.
[35] Sáfár, É., Marshall, I., Sign language translation via DRT and HPSG. In: Computational Linguistics Intelligent Text Processing. Springer, 2002, pp. 58–68.
[36] Shieber, S.M., An Introduction to UnificationBased Approaches. Center for the Study of, 1986.
[37] Slobin, D.I., Hoiting, N., Anthony, M., Biederman, Y., Kuntze, M., Lindert, R., Pyers, J., Thumann, H., Weinberg, A., Sign language transcription at the level of meaning components: The Berkeley Transcription System (BTS). Sign : Language : & : Linguistics 4, 2001, pp. 63–104.
[38] Speers, D., Representation of American sign language for machine translation. Georgetown : University, 2002.
[39] Stein, D., Schmidt, C., Ney, H., Sign language machine translation overkill. In: IWSLT, 2010, pp. 337–344.
[40] Stokoe Jr, W.C., Sign Language Diglossia, 1969.
[41] Stokoe, W.C., Sign language structure. University of Buffalo Press, 1960.
[42] Sutton, V., Sutton Movement Shorthand: A Quick, Visual, Easy-to-learn Method of Recording Dance Movement. The Classical Ballet Key. Movement Shorthand Society, 1973.
[43] Sutton, V., Lessons in sign writing. Textbook and Workbook (Second Edition), The Center for Sutton Movement Writing, Inc., La Jolla, CA, 1995.
[44] Toma, P., Systran as a multilingual machine translation system. In: Proceedings Third European Congress Information Systems Networks, Overcoming Language barrier, 1977, pp. 569–581.
[45] Trujillo, A., Transfer Machine Translation. In: Translation Engines Techniques Machine Translation. Springer, 1999, pp. 121–166.
[46] Veale, T., Conway, A., Cross modal comprehension in zardoz an english to signlanguage translation system. In: Proceedings Seventh International Workshop Natural Language Generation. Association for Computational Linguistics, 1994, pp. 249–252.
[47] Zhao, L., Kipper, K., Schuler, W., Vogler, C., Badler, N., Palmer, M., A machine translation system from English to American Sign Language. In: Envisioning machine Translation information future. Springer, 2000, pp. 54–67.
