Augmenting Websites with Voice Commands: An Approach Focused on Accessibility
DOI:
https://doi.org/10.13052/jwe1540-9589.2421Keywords:
Information websites, voice interaction, web accessibility, web augmentationAbstract
Even now, users with disabilities encounter serious barriers when accessing the Web. In particular, blind and visually impaired users encounter difficulties browsing and reading the contents of a website. Screen readers provide some assistance, yet, as they are unable to interpret the Web structure, they summarise information and read specific labelled fragments. Therefore, the overall comprehension of the text remains challenging. In this sense, in order to improve the accessibility of websites on the fly, we propose a Web augmentation framework for accessibility (WAFRA). Our framework uses Web augmentation techniques that extend the website with voice interaction and new actions: label text fragments, read aloud these fragments, facilitate navigation, increase font size and show videos. In order to perform this accessibility improvement, we automatically provide annotations from DBPedia regarding important information for end users. Moreover, we also provide the option that intermediary users add new annotations for labelling or including more specific information, which can be shared with other users by crowdsourcing. The evaluation of the framework shows its usefulness to ease website access for users with visual disabilities compared to using screen readers.
Downloads
References
Aboubakr Aqle, Dena Al-Thani, and Ali Jaoua. Can search result summaries enhance the web search efficiency and experiences of the visually impaired users? Universal Access in the Information Society, 21(1):171–192, 2022.
Vikas Ashok, Syed Masum Billah, Yevgen Borodin, and IV Ramakrishnan. Auto-Suggesting Browsing Actions for Personalized Web Screen Reading. In Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization, UMAP ’19, page 252–260, 2019.
Marcos Baez, Cinzia Cappiello, Claudia M. Cutrupi, Maristella Matera, Isabella Possaghi, Emanuele Pucci, Gianluca Spadone, and Antonella Pasquale. Supporting natural language interaction with the web. In Web Engineering, page 383–390, Cham, 2022. Springer International Publishing.
Marcos Baez, Claudia Maria Cutrupi, Maristella Matera, Isabella Possaghi, Emanuele Pucci, Gianluca Spadone, Cinzia Cappiello, and Antonella Pasquale. Exploring challenges for conversational web browsing with blind and visually impaired users. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems, CHI EA ’22. Association for Computing Machinery, 2022.
Marcos Baez, Florian Daniel, and Fabio Casati. Conversational Web Interaction: Proposal of a Dialog-Based Natural Language Interaction Paradigm for the Web. In Proceedings of the Third International Workshop on Chatbot Research and Design, 2019.
Jeffrey P. Bigham, Craig M. Prince, and Richard E. Ladner. WebAnywhere: A Screen Reader on-the-Go. In Proceedings of the 2008 International Cross-Disciplinary Conference on Web Accessibility (W4A), page 73–82, 2008.
Yevgen Borodin, Jeffrey P. Bigham, Glenn Dausch, and I. V. Ramakrishnan. More than Meets the Eye: A Survey of Screen-Reader Browsing Strategies. In Proceedings of the International Cross Disciplinary Conference on Web Accessibility (W4A), W4A ’10, 2010.
Niels Olof Bouvin. Unifying Strategies for Web Augmentation. In Proceedings of the Tenth ACM Conference on Hypertext and Hypermedia : Returning to Our Diverse Roots: Returning to Our Diverse Roots, pages 91–100, 1999.
Julia Cambre, Alex C Williams, Afsaneh Razi, Ian Bicking, Abraham Wallin, Janice Tsai, Chinmay Kulkarni, and Jofish Kaye. Firefox voice: An open and extensible voice assistant built upon the web. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, CHI ’21. Association for Computing Machinery, 2021.
Wendy Chisholm, Gregg Vanderheiden, and Ian Jacobs. Web Content Accessibility Guidelines 1.0. Interactions, 8(4):35–54, 2001.
Oscar Díaz and Cristóbal Arellano. The Augmented Web: Rationales, Opportunities, and Challenges on Browser-Side Transcoding. ACM Trans. Web, 9(2):8:1–8:30, 2015.
Oscar Díaz, Cristóbal Arellano, Iñigo Aldalur, Haritz Medina, and Sergio Firmenich. End-User Browser-Side Modification of Web Pages. In Web Information Systems Engineering – WISE 2014, pages 293–307, 2014.
Hamza Ed-Douibi, Javier Luis Cánovas Izquierdo, Gwendal Daniel, and Jordi Cabot. A model-based chatbot generation approach to converse with open data sources. In ICWE, 2021.
Leo Ferres, Gitte Lindgaard, Livia Sumegi, and Bruce Tsuji. Evaluating a tool for improving accessibility to charts and graphs. ACM Trans. Comput.-Hum. Interact., 20(5), 2013.
A. Garrido, S. Firmenich, G. Rossi, J. Grigera, N. Medina-Medina, and I. Harari. Personalized Web Accessibility using Client-Side Refactoring. IEEE Internet Computing, 17(4):58–66, 2013.
Marcos Gomez-Vazquez, Jordi Cabot, and Robert Clarisó. Automatic generation of conversational interfaces for tabular data analysis. In Proceedings of the 6th ACM Conference on Conversational User Interfaces, CUI ’24. Association for Computing Machinery, 2024.
Vicki L. Hanson and John T. Richards. Progress on Website Accessibility? ACM Trans. Web, 7(1):2:1–2:30, 2013.
Simon Harper and Yeliz Yesilada. Web Authoring for Accessibility (WAfA). Journal of Web Semantics, 5(3):175–179, 2007.
Sebastian Hellmann, Claus Stadler, Jens Lehmann, and Sören Auer. Dbpedia live extraction. In On the Move to Meaningful Internet Systems: OTM 2009, pages 1209–1223. Springer Berlin Heidelberg, 2009.
Royce Kimmons. Open to all?: Nationwide evaluation of high-priority web accessibility considerations among higher education websites. Journal of Computing in Higher Education, 29(3):434–450, 2017.
Jonathan Lazar, Aaron Allen, Jason Kleinman, and Chris Malarkey. What Frustrates Screen Reader Users on the Web: A Study of 100 Blind Users. International Journal of Human–Computer Interaction, 22(3):247–269, 2007.
Andrea Mangiatordi and Harpreet Singh Sareen. Farfalla project: browser-based accessibility solutions. In Proceedings of the International Cross-Disciplinary Conference on Web Accessibility, page 21, 2011.
Jesús López Miján, Irene Garrigós, and Sergio Firmenich. Supporting Personalization in Legacy Web Sites Through Client-Side Adaptation. In Alessandro Bozzon, Philippe Cudre-Maroux, and Cesare Pautasso, editors, Web Engineering, pages 588–592, 2016.
Ignacio Peinado and Manuel Ortega-Moral. Making Web Pages and Applications Accessible Automatically Using Browser Extensions and Apps. In Universal Access in Human-Computer Interaction. Design for All and Accessibility Practice, pages 58–69, 2014.
Christopher Power, André Freire, Helen Petrie, and David Swallow. Guidelines Are Only Half of the Story: Accessibility Problems Encountered by Blind Users on the Web. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 433–442, 2012.
G. V. R. J. S. Prasad, M. S. Soumya, and V. Choppella. Renarrating web pages for improving information accessibility. In 2017 12th International Conference on Intelligent Systems and Knowledge Engineering (ISKE), pages 1–8, 2017.
Gonzalo Ripa, Manuel Torre, Sergio Firmenich, and Gustavo Rossi. End-User Development of Voice User Interfaces Based on Web Content. In End-User Development, pages 34–50, 2019.
Katerine Romeo, Edwige Pissaloux, and Frédéric Serin. Accessibility to textual and visual information on websites for visually impaired persons. 2019.
Daisuke Sato, Masatomo Kobayashi, Hironobu Takagi, Chieko Asakawa, and Jiro Tanaka. How Voice Augmentation Supports Elderly Web Users. In The Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility, pages 155–162, 2011.
Daisuke Sato, Shaojian Zhu, Masatomo Kobayashi, Hironobu Takagi, and Chieko Asakawa. Sasayaki: Augmented Voice Web Browsing Experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 2769–2778, 2011.
Anastasia Schaadhardt, Alexis Hiniker, and Jacob O. Wobbrock. Understanding blind screen-reader users’ experiences of digital artboards. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 2021.
Schema. Schema.org, 2022.
Constantine Stephanidis and Anthony Savidis. Universal Access in the Information Society: Methods, Tools, and Interaction Technologies. Universal Access in the Information Society, 1(1):40–55, 2001.
Zan Sun, Amanda Stent, and I. V. Ramakrishnan. Dialog Generation for Voice Browsing. In Proceedings of the 2006 International Cross-Disciplinary Workshop on Web Accessibility: Building the Mobile Web: Rediscovering Accessibility?, page 49–56, 2006.
Hironobu Takagi, Shinya Kawanaka, Masatomo Kobayashi, Daisuke Sato, and Chieko Asakawa. Collaborative web accessibility improvement: challenges and possibilities. In Proceedings of the 11th International Conference on Computers and Accessibility, pages 195–202, 2009.
P. Verma, R. Singh, and A. Kumar Singh. A Framework for the Next Generation Screen Readers for Visually Impaired. International Journal of Computer Applications, 47:31–38, 2012.
Annemarie Wittig, Aleksandr Perevalov, and Andreas Both. Towards bridging the gap between knowledge graphs and chatbots. In Web Engineering, page 315–322, Cham, 2022. Springer International Publishing.
Yeliz Yesilada, Robert Stevens, Simon Harper, and Carole Goble. Evaluating DANTE: Semantic Transcoding for Visually Disabled Users. ACM Trans. Comput.-Hum. Interact., 14(3):14–es, 2007.
Kyunghye Yoon, Rachel Dols, Laura Hulscher, and Tara Newberry. An exploratory study of library website accessibility for visually impaired users. Library & Information Science Research, 38(3):250–258, 2016.
