Comparing Voice Assistant Risks and Potential with Technology-Based Users: A Study from Germany and Spain

Authors

  • Andreas M. Klein Department of Computer Languages and Systems, University of Seville, Spain https://orcid.org/0000-0003-3161-1202
  • Maria Rauschenberger Faculty of Technology, University of Applied Sciences Emden/Leer, Germany
  • J¨org Thomaschewski Faculty of Technology, University of Applied Sciences Emden/Leer, Germany
  • Maria Jos´e Escalona Department of Computer Languages and Systems, University of Seville, Spain

DOI:

https://doi.org/10.13052/jwe1540-9589.2071

Abstract

Currently, voice assistants (VAs) are trendy and highly available. The VA adoption rate of internet users differs among European countries and also in the global view. Due to speech intelligibility and privacy concerns, using VAs is challenging. Additionally, user experience (UX) assessment methods and VA improvement possibilities are still missing, but are urgently needed to overcome users’ concerns and increase the adoption rate. Therefore, we conducted an intercultural study of technology-based users from Germany and Spain, expecting that higher improvement potential would outweigh concerns about VAs. We investigated VA use in terms of availability versus actual use, usage patterns, concerns, and improvement proposals. Comparing Germany and Spain, our findings show that nearly the same amount of intensive VA use is found in both technology-based user groups. Despite cultural differences, further results show very similar tendencies, e.g., frequency of use, privacy concerns, and demand for VA improvements.

Downloads

Download data is not yet available.

References

Frank Bentley, Chris Luvogt, Max Silverman, Rushani Wirasinghe,Brooke White, and Danielle Lottridge. Understanding the Long-Term Use of Smart Speaker Assistants. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 2(3), sep 2018.

Maresa Biermann, Evelyn Schweiger, and Martin Jentsch. Talking to Stupid?!? Improving Voice User Interfaces. In Holger Fischer and Steffen Hess, editors, Mensch und Computer 2019 - Usability Professionals, Bonn, 2019. Gesellschaft f¨ur Informatik e.V. Und German UPA e.V.

Jacob Cohen. Statistical power analysis for the behavioral sciences. Academic press, 2013.

Michael H. Cohen, James P. Giangola, and Jennifer Balogh. Voice User Interface Design. Addison-Wesley, 2004.

Aarthi Easwara Moorthy and Kim-Phuong L Vu. Voice Activated Personal Assistant: Acceptability of Use in the Public Space. In Sakae Yamamoto, editor, Human Interface and the Management of Information. Information and Knowledge in Applications and Services, pages 324–334, Cham, 2014. Springer International Publishing.

BVDW e.V. Digital Trends Umfrage zu digitalen Sprachassistenten. Technical report, Bundesverband Digitale Wirtschaft (BVDW) e.V. Bundesverband Digitale, 2017.

Fernando Forte. Distribution of university students enrolled at Spanish universities in 2018/2019, by field of study and gender, 2020.

Statista GmbH. STEM first-year students at German universities by 2019/2020, 2020.

Marc Hassenzahl and Noam Tractinsky. User experience - a research agenda. Behaviour & Information Technology, 25(2):91–97, 2006.

Kate Hone. Usability measurement for speech systems : SASSI revisited. In Proceedings of CHI, 2014.

Matthew B Hoy. Alexa, Siri, Cortana, and More: An Introduction to Voice Assistants. Medical Reference Services Quarterly, 37(1):81–88, 2018.

ISO 9241-210:2019. Ergonomics of human-system interaction — Part 210: Human-centred design for interactive systems. Technical report, https://www.iso.org/committee/53372.html, 2019.

Bret Kinsella and Ava Mutchler. Voice Assistant Consumer Adoption Report. Technical report, voicebot.ai PullString.com RAIN.agency, 2018.

Andreas M. Klein. Toward a User Experience Tool Selector for Voice User Interfaces. In Proceedings of the 18th International Web for All Conference, W4A ’21, New York, NY, USA, 2021. Association for Computing Machinery.

Andreas M. Klein, Andreas Hinderks, Maria Rauschenberger, and J¨org Thomaschewski. Exploring Voice Assistant Risks and Potential with Technology-based Users. In Proceedings of the 16th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,, pages 147–154. INSTICC, SciTePress, 2020.

Andreas M. Klein, Andreas Hinderks, Martin Schrepp, and J¨org Thomaschewski. Construction of UEQ+ Scales for Voice Quality. In Proceedings of the Conference on Mensch Und Computer, MuC ’20, pages 1–5, New York, NY, USA, 2020. Association for Computing Machinery.

Andreas M. Klein, Andreas Hinderks, Martin Schrepp, and J¨org Thomaschewski. Measuring User Experience Quality of Voice Assistants. In 2020 15th Iberian Conference on Information Systems and Technologies (CISTI), pages 1–4, jun 2020.

Andreas M. Klein, Maria Rauschenberger, J¨org Thomaschweski, and Maria Jos´e Escalona. Protocol for Comparing Voice Assistant Risks and Potential with Technology-Based Users: A Study from Germany and Spain. Technical report, https://www.researchgate.net/, 2021.

Bettina Laugwitz, Theo Held, and Martin Schrepp. Construction and Evaluation of a User Experience Questionnaire. In Andreas Holzinger, editor, HCI and Usability for Education and Work, pages 63–76, Berlin,

Heidelberg, 2008. Springer Berlin Heidelberg.

Michael Minge and Laura Riedel. meCUE – Ein modularer Fragebogen zur Erfassung des Nutzungserlebens. In In: S. Boll, S. Maaß & R. Malaka (Hrsg.): Mensch und Computer 2013: Interaktive Vielfalt (S. 89-98)., 2013.

Prodigioso Volc´an. With P from pandemic podcast II Voice and audio study in Spain, 2020.

Aung Pyae and Tapani N Joelsson. Investigating the Usability and User Experiences of Voice User Interface: A Case of Google Home Smart Speaker. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, MobileHCI ’18, pages 127–131, New York, NY, USA, 2018.

Association for Computing Machinery.

Maria Rauschenberger, Martin Schrepp, Manuel Cota, Siegfried Olschner, and J¨org Thomaschewski. Efficient Measurement of the User Experience of Interactive Products. How to use the User Experience Questionnaire (UEQ). Example: Spanish Language Version. International Journal of Interactive Multimedia and Artificial Intelligence,

:39–45, 2013.

Dennis Schirrmacher. Source Code von m¨achtigem DDoS-Tool Mirai ver¨offentlicht, 2016.

Martin Schrepp and J¨org Thomaschewski. Design and Validation of a Framework for the Creation of User Experience Questionnaires. International Journal of Interactive Multimedia and Artificial Intelligence,

pages S. 88–95, 2019.

Alex Sciuto, Arnita Saini, Jodi Forlizzi, and Jason I Hong. ”Hey Alexa, What’s Up?”: A Mixed-Methods Studies of In-Home Conversational Agent Usage. In Proceedings of the 2018 Designing Interactive Systems Conference, DIS ’18, pages 857–868, New York, NY, USA, 2018. Association for Computing Machinery.

SPLENDID RESEARCH GmbH. Digitale Sprachassistenten, 2019. 2014 A. M. Klein et al.

Serpil Tas, Christian Hildebrandt, and Ren´e Arnold. Voice Assistants in Germany. WIK Wissenschaftliches Institut f¨ur Infrastruktur und Kommunikationsdienste GmbH, 2019. Nr.441.

Sven Tuzovic and Stefanie Paluch. Conversational Commerce – A New Era for Service Business Development?, pages 81–100. Springer Fachmedien Wiesbaden, Wiesbaden, 2018.

Downloads

Published

2021-11-16

How to Cite

Klein, A. M. ., Rauschenberger, M. ., Thomaschewski, J. ., & Escalona, M. J. . (2021). Comparing Voice Assistant Risks and Potential with Technology-Based Users: A Study from Germany and Spain. Journal of Web Engineering, 20(07), 1991–2016. https://doi.org/10.13052/jwe1540-9589.2071

Issue

Section

SPECIAL ISSUE: ADVANCED PRACTICES IN WEB ENGINEERING 2021