Behand: augmented virtuality gestural interaction for mobile phones

ABSTRACT

This paper introduces Behand. Behand is a new way of interaction that allows a mobile phone user to manipulate virtual three-dimensional objects inside the phone by gesturing with his hand. Behand provides a straightforward 3D interface, something current mobile phones do not offer, and extends the phone's input and display space. The 3D direct manipulation paradigm makes it intuitive for people of all cultural backgrounds. It is ergonomically appropriate and technically feasible. A user evaluation of the concept was carried out, showing that users find the concept "useful", "innovative" and "fun" and there are no acceptability issues. Please refer to the video accompanying this paper for a video prototype of Behand.

References

1. Sources:http://www.itwire.com/content/view/19782/1103/, http://perspectives.3ds.com/2009/05/11/equipping-our-vr-future/, http://www.xbox.com/en-US/live/projectnatal/
2. Shneiderman, B. 1983. Direct Manipulation. A Step Beyond Programming Languages. IEEE Transactions on Computers, Vol. 16, No. 8, August, pp. 57--69.
3. Shneiderman, B. 1997. Direct manipulation for comprehensible, predictable and controllable user interfaces. Proceedings of the 2nd international conference on intelligent user interfaces. Orlando, Florida, United States, pp. 33--39.
4. Henrysson, A., Billinghurst, M. and Ollila, M. 2005. Virtual Object Manipulation using a Mobile Phone. Proceedings of ICAT 2005, December 5-8, Christchurch, New Zealand.
5. Mine, M., Brooks, F. and Sequin, C. 1997. Moving Objects in Space: Exploiting Proprioception In Virtual-Environment Interaction. Proceedings of the 24th annual conference on Computer graphics and interactive techniques, August 3-8, Los Angeles, California, United States, pp. 19--26.
6. Ehrsson, H., Holmes, N. and Passingham, R. 2005. Touching a Rubber Hand: Feeling of Body Ownership Is Associated with Activity in Multisensory Brain Areas. The Journal of Neuroscience, Vol. 25, No. 45, November 9, pp. 10564--10573.
7. Hwang, J., Jung, J. and Kim, G. 2006. Manipulation of Field of View for hand-Held Virtual Reality. Proceedings of ICAT 2006, November 29 - December 1, Hangzhou, China, pp. 1204--1211.
8. Rohs, M., Schöning, J., Raubal, M., Essl, G. and Krüger, A. 2007. Map Navigation with Mobile Devices: Virtual versus Physical Movement with and without Visual Context. Proceedings of ICMI'07, November 12-15, Nagoya, Aichi, Japan.
9. Bowman, D., Kruijff, E., La Viola, J., Poupyrev, I. 2000. The Art and Science of 3D Interaction. Tutorial notes from the IEEE International Virtual Reality 2000 Conference, March 18-22, New Brunswick, New Jersey, United States.
10. Varga, E., Verlinden, J., Klaas, O., Langenhoff, L., van der Steen, D. and Verhagen, J. 2008. A Study on Intuitive Gestures to Control Multimedia Applications. Proceedings of IADIS International Conference Interfaces and Human Computer Interaction, July 25-27, Amsterdam, The Netherlands.
11. Bowman, D. and Wingrave, C. 2001. Design and Evaluation of Menu Systems for Immersive Virtual Environments. Proceedings of IEEE Virtual Reality Conference 2001, March 13-17, Yokohama, Japan.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Touch screens

    • Interaction paradigms

  • Interaction design

    • Interaction design process and methods

      • User centered design