OrBI – A Hands-free Virtual Reality User Interface for Mobile Devices

Authors

  • Paulo Victor de Magalhães Rozatto Computer Science Department, Federal University of Juiz de Fora, Brazil
  • André Luiz Cunha de Oliveira Computer Science Department, Federal University of Juiz de Fora, Brazil
  • Rodrigo Luis de Souza da Silva Computer Science Department, Federal University of Juiz de Fora, Brazil https://orcid.org/0000-0002-4187-8798

DOI:

https://doi.org/10.13052/jmm1550-4646.1866

Keywords:

Virtual Reality, User Interface, Hands-free

Abstract

The purpose of this paper is to present OrBI, a framework for developing hands-free user interfaces for interacting with low-cost Virtual Reality systems through mobile devices. The proposed implementation was developed and used in various Virtual Reality apps. To assess OrBI’s precision and ease to use, we submit the framework to a quantitative and qualitative evaluation. The findings indicate that the proposed interface model is easy to use and have a suitable precision. The findings also showed that the framework might be challenging for older people to use and, in some cases, tiresome.

Downloads

Download data is not yet available.

Author Biographies

Paulo Victor de Magalhães Rozatto, Computer Science Department, Federal University of Juiz de Fora, Brazil

Paulo Victor de Magalhães Rozatto is an undergraduate student in Computer Science at the Federal University of Juiz de Fora. He has a IT Technician certificate from the Federal Institute of Rio de Janeiro (2018). His research interests are Computer Graphics, Augmented Reality, and Virtual Reality.

André Luiz Cunha de Oliveira, Computer Science Department, Federal University of Juiz de Fora, Brazil

André Luiz Cunha de Oliveira is an undergraduate student in Computer Science at the Federal University of Juiz de Fora. His research interests are Computer Graphics, Augment Reality and Virtual Reality.

Rodrigo Luis de Souza da Silva, Computer Science Department, Federal University of Juiz de Fora, Brazil

Rodrigo Luis de Souza da Silva is an Associate Professor in the Department of Computer Science at Federal University of Juiz de Fora. He has a B.S. in Computer Science from the Catholic University of Petropolis (1999), M.S. in Computer Science from Federal University of Rio de Janeiro (2002), Ph.D. in Civil Engineering from Federal University of Rio de Janeiro (2006) and a postdoc in Computer Science from the National Laboratory for Scientific Computing (2008). His main research interests are Augmented Reality, Virtual Reality, Scientific Visualization and Computer Graphics.

References

Sampath Shanmugam, Vaishak R Vellore, and V Sarasvathi. Vrnav: A framework for navigation and object interaction in virtual reality. In 2017 2nd International Conference on Computational Systems and Information Technology for Sustainable Solution (CSITSS), pages 1–5. IEEE, 2017.

Taizhou Chen, Lantian Xu, Xianshan Xu, and Kening Zhu. Gestonhmd: Enabling gesture-based interaction on low-cost vr head-mounted display. IEEE Transactions on Visualization and Computer Graphics, 27(5):2597–2607, 2021.

Siqi Luo and Robert J Teather. Camera-based selection with cardboard hmds. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pages 1066–1067. IEEE, 2019.

Meghal Dani, Gaurav Garg, Ramakrishna Perla, and Ramya Hebbalaguppe. Mid-air fingertip-based user interaction in mixed reality. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), pages 174–178. IEEE, 2018.

Alon Grinshpoon, Shirin Sadri, Gabrielle J Loeb, Carmine Elvezio, and Steven K Feiner. Hands-free interaction for augmented reality in vascular interventions. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pages 751–752. IEEE, 2018.

Abraham Hashemian, Matin Lotfaliei, Ashu Adhikari, Ernst Kruijff, and Bernhard Riecke. Headjoystick: Improving flying in vr using a novel leaning-based interface. IEEE Transactions on Visualization and Computer Graphics, 2020.

Xueshi Lu, Difeng Yu, Hai-Ning Liang, Wenge Xu, Yuzheng Chen, Xiang Li, and Khalad Hasan. Exploration of hands-free text entry techniques for virtual reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pages 344–349. IEEE, 2020.

Wenge Xu, Hai-Ning Liang, Yuxuan Zhao, Tianyu Zhang, Difeng Yu, and Diego Monteiro. Ringtext: Dwell-free and hands-free text entry for mobile head-mounted displays using head motions. IEEE transactions on visualization and computer graphics, 25(5):1991–2001, 2019.

Arindam Dey, Amit Barde, Bowen Yuan, Ekansh Sareen, Chelsea Dobbins, Aaron Goh, Gaurav Gupta, Anubha Gupta, and Mark Billinghurst. Effects of interacting with facial expressions and controllers in different virtual environments on presence, usability, affect, and neurophysiological signals. International Journal of Human-Computer Studies, 160:102762, 2022.

Lihang Wen, Jianlong Zhou, Weidong Huang, and Fang Chen. A survey of facial capture for virtual reality. IEEE Access, 10:6042–6052, 2022.

Nazmi Sofian Suhaimi, James Mountstephens, and Jason Teo. A dataset for emotion recognition using virtual reality and eeg (der-vreeg): Emotional state classification using low-cost wearable vr-eeg headsets. Big Data and Cognitive Computing, 6(1), 2022.

José Rouillard, Hakim Si-Mohammed, and François Cabestaing. A pilot study for a more Immersive Virtual Reality Brain-Computer Interface. In International Conference on Applied Human Factors and Ergonomics (AHFE), New-York, United States, July 2022.

Erdhi Widyarto Nugroho and Bernardinus Harnadi. The method of integrating virtual reality with brainwave sensor for an interactive math’s game. In 2019 16th International Joint Conference on Computer Science and Software Engineering (JCSSE), pages 359–363, 2019.

Pedro Monteiro, Guilherme Goncalves, Hugo Coelho, Miguel Melo, and Maximino Bessa. Hands-free interaction in immersive virtual reality: A systematic review. IEEE Trans. Vis. Comput. Graph., 27(5):2702–2713, 2021.

Yannick Weiß, Daniel Hepperle, Andreas Sieß, and Matthias Wölfel. What user interface to use for virtual reality? 2d, 3d or speech–a user study. In 2018 International Conference on Cyberworlds (CW), pages 50–57. IEEE, 2018.

Lucas Diniz da Costa, Paulo Victor de Magalhães Rozatto, André Luiz Cunha de Oliveira, and Rodrigo Luis de Souza da Silva. VR Tools – A free open-source platform for virtual and augmented reality applications on the web. Journal of Mobile Multimedia, pages 27–42, 2022.

Published

2022-07-18

Issue

Section

Articles

Most read articles by the same author(s)