Can virtual reality be better controlled by a smart phone than by a mouse and a keyboard?

ABSTRACT

VR controllers use different sensors that are also included in modern mobile phones. This opens up the possibility of using mobile phones to control virtual reality. In our work, we focus on such possibilities, the few existing solutions and their shortcomings serving as our points of depart. We designed a control system based on metaphors from other areas that were adapted to VR control with a mobile phone. We consequently proceeded to compare our system with the traditional control with keyboard and mouse. This article contains the results of this comparison and the discussion.

References

1. J. Bauer, S. Thelen and A. Ebert, "Using smart phones for large-display interaction," in Internat. Conf. on User Science and Engineering, IEEE, 2011, pp. 42--47.
2. E. von Glasersfeld, "Learning as Constructive Activity," in Proc. of the 5th Annual Meeting of the North American Group of Psychology in Mathematics Education, Vol. 1. Montreal: PME-NA, 1983. pp. 83--99.
3. W. Hürst and M. Helder, "Mobile 3D graphics and virtual reality interaction," in Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology, Lisbon, ACM, 2011, pp. 28:1--28:8.
4. C. Hyunju, K. Sangchul, B. Jinsuk and P. Fisher, "Motion recognition with smart phone embedded 3-axis accelerometer sensor," in International Conference on Systems, Man, and Cybernetics, 2012, pp 919--924.
5. K. Kin, M. Agrawala and T. DeRose, "Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation," in Proceedings of Graphics Interface 2009, Kelowna, IEEE, 2009, pp. 919--924.
6. K. Kin, T. Miller, B. Bollensdorff, T. DeRose, B. Hartmann and M. Agrawala, "Eden: a professional multitouch tool for constructing virtual organic environments," in Proceedings of the SIGCHI Conf. on Human Factors in Computing Systems, Vancouver: ACM, 2011, pp.1343--52.
7. F. Klompmaker, K. Nebe and J. Eschenlohr, "Towards Multimodal 3D Tabletop Interaction Using Sensor Equipped Mobile Devices," in Mobile Computing, Applications, and Services, Springer, 2013, pp. 100--114.
8. A. Kovárová, "Special Interaction Approaches and their Impact on Usability," Information Sciences and Technologies Bulletin of the ACM Slovakia, 2011. vol. 3, no. 3, pp. 14--25.
9. D. Maisch, "Children and Mobile Phones... Is There a Health Risk?," Journal of Australasian College of Nutritional & Environmental Medicine, 2003, vol. 22, pp. 3--8.
10. H. Patel, O. Stefani, S. Sharples, I. Karaseitanidis, H. Hoffmann and A. Amditis, "Human centred design of 3-D interaction devices to control virtual environments," Int. J. Hum.-Comput. Stud., vol. 64, no. 3, 2006, pp. 207--220.
11. D. Sachs, Sensor Fusion on Android Devices: A Revolution in Motion Processing, Google Tech Talk, 2010.
12. M. de Souza, D. Carvalho, P. Barth, J. Ramos, E. Comunello and A. von Wangenheim, "Using Acceleration Data from Smartphones to Interact with 3D Medical Data," in Proceedings of the 2010 23rd SIBGRAPI Conf. on Graphics, Patterns and Images, Washington, IEEE, 2010, pp. 339--345.
13. D. Ullrich and S. Diefenbach, "INTUI. Exploring the Facets of Intuitive Interaction," in Mensch & Computer, Oldenbourg Verlag, 2010, pp. 251--260.

Index Terms

• Applied computing

  • Computers in other domains

    • Personal computers and PC applications

• Computing methodologies

  • Computer graphics

    • Graphics systems and interfaces

      • Virtual reality

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction paradigms

      • Mixed / augmented reality

      • Virtual reality