Design Guidelines for Web Interfaces of Home Automation Systems Accessible via Screen Reader

  • Marina Buzzi IIT–CNR, Pisa, Italy
  • Barbara Leporini ISTI–CNR, Pisa, Italy
  • Clara Meattini ISTI–CNR, Pisa, Italy
Keywords: Smart homes, home automation, accessible interfaces, blind users


Home Automation Systems (HAS) – also referred to as smart homes – exploit multiple components such as sensors, RFID readers, wireless devices, and remote control systems to enable easy interaction with smart appliances and devices, and to automate performing sequences of tasks to make human-device interaction simpler and life more comfortable. For people with vision impairment, especially those who are unable to see at all, smart homes can be a powerful tool for enhancing personal autonomy, provided that the system offers suitable device integration and accessible interfaces with a simple interaction via keyboard, assistive technology and other modalities such as voice and gestures.

This paper investigates the accessibility of web interfaces when interacting with HAS components via screen reader assistive technology, in order to propose potential suggestions to developers. Web interfaces are particularly considered in this study in order to support screen reader users who are not yet skilled in using touch-screen devices. Specifically, based on collected accessibility and usability issues, as well as users’ expectations and preferences, a Web-based prototype has been designed and optimized especially for interaction via screen reader. After describing an evaluation conducted with a small group of skilled screen reader users, several guidelines are suggested for designers of HAS interfaces.


Download data is not yet available.

Author Biographies

Marina Buzzi, IIT–CNR, Pisa, Italy

Marina Buzzi, technologist at the Italian National Research Council (CNR), leads the Web Accessibility and Usability group @ the Institute for Informatics and Telematics (IIT-CNR). She received her M.Sc. degree in Computer Science from the University of Pisa in 1991. Expert in networking design, Internet Services Management, and Web applications, in 2004 she shifted her research focus to accessible and participative design techniques to create usable applications for users with special needs. Since 2010 she has investigated how to exploit IoT and RFID systems to improve people’s lives. She has coordinated technological and research projects, designing accessible games, training and rehabilitation systems for people with cognitive impairment and web apps for teaching children with autism. She is coauthor of more than one hundred papers.

Barbara Leporini, ISTI–CNR, Pisa, Italy

Barbara Leporini earned her PhD in Computer Science at University of Pisa in 2003 with a dissertation on accessibility and usability subject related to websites. She is now a researcher in Human-Computer Interaction (HCI) at the CNR in Pisa (ISTI). Barbara investigates techniques and methods to make user interfaces accessible and usable to users with special needs. She is the author of numerous publications and participates in many projects in the field. In addition to research, Barbara has been teaching computer science classes and participating in boards and groups working on accessibility applied to various areas. In particular, she has been collaborating with the working group for the requirements defined by Italian law on accessibility. She is also the director of the Institute for Research, Training and Rehabilitation (I.Ri.Fo.R.) for the visually-impaired of the Region of Tuscany.

Clara Meattini, ISTI–CNR, Pisa, Italy

Clara Meattini earned her B.Sc. and M.Sc. degrees in Digital Humanities from the University of Pisa, with a thesis focusing on accessible publishing and assistive technologies. She has acquired solid experience in smart programming solutions and a thorough knowledge of accessibility standards. Clara is passionate about ICTs and their application in human and social fields. She developed this work during her curricular stage at the ISTI-CNR.


Buzzi, M., Gennai, F., & Leporini, B. (2017). How Blind People Can Manage a Remote Control System: A Case Study. In International Conference on Smart Objects and Technologies for Social Good, (pp. 71–81). Springer, Cham.

Boldú, M., Paris, P., Térmens i Graells, M., Porras Serrano, M., Ribera, M., & Sulé, A. (2017). Web content accessibility guidelines: from 1.0 to 2.0.

Power, C., Freire, A., Petrie, H., & Swallow, D. (2012, May). Guidelines are only half of the story: accessibility problems encountered by blind users on the web. In Proc. of the SIGCHI Conference, (pp. 433–442). ACM.

Almeida, L. D., & Baranauskas, M. C. C. (2018). A Roadmap on Awareness of Others in Accessible Collaborative Rich Internet Applications. In Application Development and Design: Concepts, Methodologies, Tools, and Applications, (pp. 479–500). IGI Global.

Carvalho, L. P., Ferreira, L. P., & Freire, A. P. (2016). Accessibility evaluation of rich Internet applications interface components for mobile screen readers. In Proc. of the 31st Annual ACM Symp. on Applied Computing, (pp. 181–186). ACM.

Velasco, C. A., Denev, D., Stegemann, D., & Mohamad, Y. (2008, April). A web compliance engineering framework to support the development of accessible rich internet applications. In Proc. of W4A, (pp. 45–49). ACM.

Stephanidis, C. (Ed.) (2009). The Universal Access Handbook. CRC Press, 2009. pp. 1034.

Buzzi, M., Leporini, B., & Meattini, C. Simple Smart Homes Web Interfaces for Blind People. In Proceedings of WEBIST 2018: 223–230.

Leporini, B., & Buzzi, M. (2018). Home Automation for an Independent Living: Investigating the Needs of Visually Impaired People. In Proceedings of the Internet of Accessible Things, (p. 15). ACM.

Rogers, Y. (2006). Moving on from weiser’s vision of calm computing: Engaging ubicomp experiences. In International Conference on Ubiquitous Computing, (pp. 404–421). Springer, Berlin, Heidelberg.

Alam, M. R., Reaz, M. B. I., & Ali, M. A. M. (2012). A review of smart homes – Past, present, and future. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 42(6), 1190–1203.

Chan, M., Campo, E., Estève, D., & Fourniols, J. Y. (2009). Smart homes – current features and future perspectives. Maturitas, 64(2), 90–97.

Marek, K. D., & Rantz, M. J. (2000). Aging in place: a new model for long-term care. Nursing Administration Quarterly, 24(3), 1–11.

Rodin, J. (1986). Aging and health: Effects of the sense of control. Science, 233(4770), 1271–1276.

Santos V., Bartolomeu P., Fonseca J., & Mota A. (2007, July). B-live-a home automation system for disabled and elderly people. In Industrial Embedded Systems, 2007. SIES’07. Int. Symposium on, (pp. 333–336). IEEE.

Portet, F., Vacher, M., Golanski, C., Roux, C., & Meillon, B. (2013). Design and evaluation of a smart home voice interface for the elderly: acceptability and objection aspects. Personal and Ubiquitous Computing, 17(1), 127–144.

Park, E., Kim, S., Kim, Y., & Kwon, S. J. (2018). Smart home services as the next mainstream of the ICT industry: determinants of the adoption of smart home services. Universal Access in the Information Society, 17(1), 175–190.

Who. Global data on visual impairment 2010, https://www.who. int/blindness/publications/globaldata/en/, retrieved May 2019.

Swagerty, J. D. (1995). The impact of age-related visual impairment on functional independence in the elderly. Kansas Medicine: the Journal of the Kansas Medical Society, 96(1), 24–26.

Gallagher, B., & Jackson, J. (2012). Ageing and the impact of vision loss on independent living and mobility. Optometry in Practice, 13(2), 45–54.

Espada, J. P., Martínez, O. S., Lovelle, J., G-Bustelo, B. C. P., Álvarez, M.Á., & García, A. G. (2011). Modeling architecture for collaborative virtual objects based on services. Journal of Network and Computer Applications, 34(5), 1634–1647.

Tan, L., & Wang, N. (2010, August). Future internet: The internet of things. In 2010 3rd International Conference on Advanced Computer Theory and Engineering (ICACTE), (Vol. 5, pp. V5–376). IEEE.

Domingo, M. C. (2012). An overview of the Internet of Things for people with disabilities. Journal of Network and Computer Applications, 35(2), 584–596.

Darianian, M., & Michael, M. P. (2008, December). Smart home mobile RFID-based Internet-of-Things systems and services. In 2008 International Conference on Advanced Computer Theory and Engineering, (pp. 116–120). IEEE.

Blasco, R., Marco, Á., Casas, R., Cirujano, D., & Picking, R. (2014). A smart kitchen for ambient assisted living. Sensors, 14(1), 1629–1653.

Gullà, F., Ceccacci, S., Menghi, R., & Germani, M. (2016, June). An adaptive smart system to foster disabled and elderly people in kitchen-related task. In Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments, (p. 27). ACM.

Lanigan, P. E., Paulos, A. M., Williams, A. W., Rossi, D., & Narasimhan, P. (2006, October). Trinetra: Assistive Technologies for Grocery Shopping for the Blind. In ISWC, (pp. 147–148).

de Oliveira, G. A. A., de Bettio, R. W., & Freire, A. P. (2016, October). Accessibility of the smart home for users with visual disabilities: an evaluation of open source mobile applications for home automation. In Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems, (p. 29). ACM.

Mäyrä, F., Soronen, A., Koskinen, I., Kuusela, K., Mikkonen, J., Vanhala, J., & Zakrzewski, M. (2006). Probing a proactive home: Challenges in researching and designing everyday smart environments. Human Technology: An Interdisciplinary Journal on Humans in ICT Environments.

Callejas Z., & Lopez-Cozar R. (2009). Designing smart home interfaces for the elderly. SIGACCESS Newsletter 95.

Liu, L., Stroulia, E., Nikolaidis, I., Miguel-Cruz, A., & Rincon, A. R. (2016). Smart homes and home health monitoring technologies for older adults: A systematic review. Int. Journal of Medical Informatics, 91, 44–59.

Vacher, M., Lecouteux, B., Istrate, D., Joubert, T., Portet, F., Sehili, M., & Chahuara, P. (2013). Experimental evaluation of speech recognition technologies for voice-based home automation control in a smart home. In 4th workshop on Speech and Language Processing for Assistive Technologies, (pp. 99–105).

Brady E., Morris M. R., Zhong Y., White S., & Bigham J. P. (2013). Visual challenges in the everyday lives of blind people. In Proc. of the SIGCHI Conference, (pp. 2117–2126). ACM.

Jeet, V., Dhillon, H.S., & Bhatia, S. (2015,April). Radio frequency home appliance control based on head tracking and voice control for disabled person. In Communication Systems and Network Technologies (CSNT), 2015 Fifth Int. Conf. on, (pp. 559–563). IEEE.

Giraud, S., Thérouanne, P., & Steiner, D. D. (2018). Web accessibility: Filtering redundant and irrelevant information improves website usability for blind users. Int. Journal of Human-Computer Studies, 111, 23–35.