AN INTELLIGENT VISUAL DICTIONARY FOR ITALIAN SIGN LANGUAGE
Keywords:
Visualisation, treemap, ontology, web dictionary, sign languageAbstract
Sign languages are visual-gestural languages developed mainly in deaf communities; their tempo-spatial nature makes it dicult to write them, yet several transcription systems are available for them. Most sign language dictionaries interact with users via a transcription-based interface; thus users need to be expert of that specic transcription system. The e-LIS dictionary is the rst web bidirectional dictionary for Italian sign language-Italian; using the current e-LIS interface, users can dene a sign interacting with intuitive iconic images, ignoring the underlying transcription system. Neverthe- less this interface assumes that its users are expert signers, knowledgeable about the formational rules of signs. The e-LIS ontology, which species how to form a sign, allows even non-expert signers to use the dictionary from Italian sign language to Italian. This is realised through a novel visual interface for transparently browsing and querying the e-LIS ontology and the underlying database. The interface prototype was designed following the user centred design methodology. As such, our work constitutes the rst attempt at making the e-LIS dictionary an intelligent visual dictionary, usable by learners of Italian sign language who are not expert signers yet. This paper reports on the design of the rst prototype of the ontology-based visual interface, and outlines its evaluation plan.
Downloads
References
C. Vettori, O. Streiter and J. Knapp (2004), From Computer Assisted Language Learning (CALL)
to sign language processing: the design of e-LIS, an electronic bilingual dictionary of italian sign
language & italian, Proceedings of the Workshop on the Representation and Processing of Sign
Languages, LREC.
E. Radutzky (2001), Dizionario bilingue elementare della Lingua Italiana dei Segni, Kappa.
e-LIS project, URL: http://elis.eurac.edu/.
T. Catarci, P. Dongilli, T. Di Mascio, E. Franconi, G. Santucci and S. Tessaris (2004), An ontol-
ogy based visual tool for query formulation support, Proceedings of the 16th Biennial European
Conference on Arti cial Intelligence, ECAI 2004 (Valencia).
(2007), Conductive and sensorineural hearing loss, Deafness and hearing aids, URL: http://www.
deafness-and-hearingaids.net/2007/10/25/conductive-and-sensorineural-hearing-loss/
(2007), Sensorineural deafness, MedlinePlus, U.S. National Library of Medicine, URL: http://
www.nlm.nih.gov/medlineplus/ency/article/003291.htm
N. Loundon, D. Busquet, G. Roger, L. Moatti and E.N. Garabedian (2000), Audiophonological re-
sults after cochlear implantation in 40 congenitally deaf patients: preliminary results, International
Journal of Pediatric Otorhinolaryngology, Vol. 56(1):9{21.
A. Malcolm (2000), Deafness, an introduction, Report from STC's Special Needs Committee, 47th
International STC Conference (Orlando).
M. Vermeerbergen (2006), Past and current trends in sign language research, Language and Communication,
Vol. 26(2), April.
B. Garcia (2006), The methodological, linguistic and semiological bases for the elaboration of a
written form of French sign language (LSF), Proceedings of the Workshop on the Representation
and Processing of Sign Languages, LREC.
E. Pizzuto, P. Rossini and T. Russo (2006), Representing signed languages in written form: ques-
tions that need to be posed, Proceedings of the Workshop on the Representation and Processing
of Sign Languages, LREC.
D. Berry (2001), Requirements for maintaining Web access for hearing-impaired individuals, Proceedings
of the Third International Workshop on Web Site Evolution, (Florence), IEEE Computer
Society.
(2000), Design guidelines for electronic publications, multimedia and the Web, WGBH/NCAM
The WGBH National Center for Accessible Media.
UNESCO (1987), Education of deaf children and young people. Guides for special needs education,
Centre of Total Communication (Copenhagen).
B. Arfe and P. Boscolo (2006), Causal coherence in deaf and hearing students' written narratives,
Discourse Processes, xlii(3):271{300.
P.V. Paul (1998), Literacy and deafness: the development of reading, writing, and literate thought,
Allyn & Bacon.
M. Marschark (2003), Cognitive functioning in deaf adults and children, Oxford Handbook of Deaf
Studies, Language, and Education, pp. 464{477, Oxford University Press (New York).
I. Fajardo, J. Abascal and J.J. Ca~nas (2004), The role of working memory and long term memory
in deaf users' hypertext navigation: review of guidelines for Web accessibility, User-Centered Interaction
Paradigms for Universal Access in the Information Society, Proceedings of the 8th ERCIM
Workshop: User Interfaces for All, pp. 320{325, Springer Berlin / Heidelberg.
Dizionario elettronico di base bilingue Lingua Italiana dei Segni-Italiano, URL: http://elisdiz.
eurac.edu/diz/.
N. Guarino (1998), Formal ontology in information systems, Formal Ontology in Information
Systems, FOIS.
P. Fillottrani, E. Franconi and S. Tessaris (2006), The new ICOM ontology editor, International
Workshop on Description Logics, DL, URL: http://www.inf.unibz.it/~franconi/icom/.
Adler:92
T. Di Mascio, R. Gennari and M. Felice (2007), A visual ontology-driven interface for a Web
sign language dictionary, Proceedings of the 1st International Workshop on Web Usability and
Accessibility, IWWUA (Nancy), LNCS 4832, Springer.
R. Gennari and T. Di Mascio (2007), An ontology for a Web dictionary of Italian sign language,
Proceedings of the 3rd International Conference of Web Information Systems, WEBIST.
T. Di Mascio (2007), Multimedia information retrieval systems: from a content-based approach to
a semantics-based approach, PhD thesis, Universita di L'Aquila.
ISO Consortium (2000), Software product evaluation: quality characteristics and guidelines for
their use, URL: http://www.tbs-sct.gc.ca/its-nit/standards/tbits26/crit26_e.asp.
C. Fluit, M. Sabou and F. van Harmelen (2004), Supporting user tasks through visualisation of
light-weight ontologies, in Handbook on ontologies, Springer, p. 415.
Nielsen Norman Group (2007), 230 tips and tricks for better usability testing.
S. Torres, I. Moreno-Torres and R. Santana (2006), Quantitative and qualitative evaluation of
linguistic input support to a prelingually deaf child with cued speech: a case study, Journal of Deaf
Studies and Deaf Education, pp. 1{11.
E. Efthimiou and E. Fotinea (2006), E-accessibility to educational content for the deaf, European
Journal of Open, Distance and E-Learning.
N. Israelite, J. Ower and G. Goldstein (2002), Hard-of-hearing adolescents and identity construc-
tion: in
uences of school experiences, peers, and teachers, Journal of Deaf Studies and Deaf Education,
vii(2):134{148.
N. Adamo-Villani (2008), A virtual learning environment for deaf children: design and evaluation,
International Journal of Social Sciences, ii(2):124{129.
P. S. Adler and T. A. Winograd (1992), Usability turning technology into tools, Oxford Press.
S. Wilcox (2003), The multimedia dictionary of American Sign Language: learning lessons about
language, technology and business, Sign Languages Studies, iii(4):379{392.
J. Nielsen and R.L. Mack (1994), Usability Inspection Methods, John Wiley and Sons, Inc.
H. Hartson, T. Andre and R. Williges (2001), Criteria for evaluating usability evaluation methods,
International Journal of Human Computer Interaction, Vol, 13, Num 4, pages 373{410.
