OrBI – A Hands-free Virtual Reality User Interface for Mobile Devices
DOI:
https://doi.org/10.13052/jmm1550-4646.1866Keywords:
Virtual Reality, User Interface, Hands-freeAbstract
The purpose of this paper is to present OrBI, a framework for developing hands-free user interfaces for interacting with low-cost Virtual Reality systems through mobile devices. The proposed implementation was developed and used in various Virtual Reality apps. To assess OrBI’s precision and ease to use, we submit the framework to a quantitative and qualitative evaluation. The findings indicate that the proposed interface model is easy to use and have a suitable precision. The findings also showed that the framework might be challenging for older people to use and, in some cases, tiresome.
Downloads
References
Sampath Shanmugam, Vaishak R Vellore, and V Sarasvathi. Vrnav: A framework for navigation and object interaction in virtual reality. In 2017 2nd International Conference on Computational Systems and Information Technology for Sustainable Solution (CSITSS), pages 1–5. IEEE, 2017.
Taizhou Chen, Lantian Xu, Xianshan Xu, and Kening Zhu. Gestonhmd: Enabling gesture-based interaction on low-cost vr head-mounted display. IEEE Transactions on Visualization and Computer Graphics, 27(5):2597–2607, 2021.
Siqi Luo and Robert J Teather. Camera-based selection with cardboard hmds. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pages 1066–1067. IEEE, 2019.
Meghal Dani, Gaurav Garg, Ramakrishna Perla, and Ramya Hebbalaguppe. Mid-air fingertip-based user interaction in mixed reality. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), pages 174–178. IEEE, 2018.
Alon Grinshpoon, Shirin Sadri, Gabrielle J Loeb, Carmine Elvezio, and Steven K Feiner. Hands-free interaction for augmented reality in vascular interventions. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pages 751–752. IEEE, 2018.
Abraham Hashemian, Matin Lotfaliei, Ashu Adhikari, Ernst Kruijff, and Bernhard Riecke. Headjoystick: Improving flying in vr using a novel leaning-based interface. IEEE Transactions on Visualization and Computer Graphics, 2020.
Xueshi Lu, Difeng Yu, Hai-Ning Liang, Wenge Xu, Yuzheng Chen, Xiang Li, and Khalad Hasan. Exploration of hands-free text entry techniques for virtual reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pages 344–349. IEEE, 2020.
Wenge Xu, Hai-Ning Liang, Yuxuan Zhao, Tianyu Zhang, Difeng Yu, and Diego Monteiro. Ringtext: Dwell-free and hands-free text entry for mobile head-mounted displays using head motions. IEEE transactions on visualization and computer graphics, 25(5):1991–2001, 2019.
Arindam Dey, Amit Barde, Bowen Yuan, Ekansh Sareen, Chelsea Dobbins, Aaron Goh, Gaurav Gupta, Anubha Gupta, and Mark Billinghurst. Effects of interacting with facial expressions and controllers in different virtual environments on presence, usability, affect, and neurophysiological signals. International Journal of Human-Computer Studies, 160:102762, 2022.
Lihang Wen, Jianlong Zhou, Weidong Huang, and Fang Chen. A survey of facial capture for virtual reality. IEEE Access, 10:6042–6052, 2022.
Nazmi Sofian Suhaimi, James Mountstephens, and Jason Teo. A dataset for emotion recognition using virtual reality and eeg (der-vreeg): Emotional state classification using low-cost wearable vr-eeg headsets. Big Data and Cognitive Computing, 6(1), 2022.
José Rouillard, Hakim Si-Mohammed, and François Cabestaing. A pilot study for a more Immersive Virtual Reality Brain-Computer Interface. In International Conference on Applied Human Factors and Ergonomics (AHFE), New-York, United States, July 2022.
Erdhi Widyarto Nugroho and Bernardinus Harnadi. The method of integrating virtual reality with brainwave sensor for an interactive math’s game. In 2019 16th International Joint Conference on Computer Science and Software Engineering (JCSSE), pages 359–363, 2019.
Pedro Monteiro, Guilherme Goncalves, Hugo Coelho, Miguel Melo, and Maximino Bessa. Hands-free interaction in immersive virtual reality: A systematic review. IEEE Trans. Vis. Comput. Graph., 27(5):2702–2713, 2021.
Yannick Weiß, Daniel Hepperle, Andreas Sieß, and Matthias Wölfel. What user interface to use for virtual reality? 2d, 3d or speech–a user study. In 2018 International Conference on Cyberworlds (CW), pages 50–57. IEEE, 2018.
Lucas Diniz da Costa, Paulo Victor de Magalhães Rozatto, André Luiz Cunha de Oliveira, and Rodrigo Luis de Souza da Silva. VR Tools – A free open-source platform for virtual and augmented reality applications on the web. Journal of Mobile Multimedia, pages 27–42, 2022.
