MagiTact: interaction with mobile devices based on compass (magnetic) sensor

ABSTRACT

In this work, we present a new technique for efficient use of 3D space around a mobile device for interaction with the device. Around Device Interaction (ADI) enables extending interaction space of small mobile and tangible devices beyond their physical boundary. Our proposed method is based on using compass (magnetic field) sensor integrated in mobile devices (e.g. iPhone 3GS, G1 Android). In this method, a properly shaped permanent magnet (e.g. in the shape of a rod, pen or a ring) is used for interaction. The user makes coarse gestures in the 3D space around the device using the magnet. Movement of the magnet affects the magnetic field sensed by the compass sensor integrated in the device. The temporal pattern of the gesture is then used as a basis for sending different interaction commands to the mobile device. Zooming, turning pages, accepting/rejecting calls, clicking items, controlling a music player, and game interaction are some example use cases. The proposed method does not impose changes in hardware specifications of the mobile device, and unlike optical methods is not limited by occlusion problems.

References

1. Starner, T. and Auxier, J. and Ashbrook, D. and Gandy, M, The gesture pendant: A self-illuminating, wearable, infrared computer vision system for home automation control and medical monitoring, International Symposium on Wearable Computing, 2000, pp. 87--94.
2. Hinckley, K., Pierce, J., Sinclair, M., and Horvitz, E. 2000. Sensing techniques for mobile interaction. In Proc. of UIST '00. ACM, pp. 91--100.
3. Baudisch, P. and Chu, G. Back-of-device interaction allows creating very small touch devices. In Proc. of CHI '09.
4. Theremin, L.S. The Design of a Musical Instrument Based on Cathode Relays. Reprinted in Leonardo Music J., No. 6, 1996, 49--50.

Index Terms

• Hardware

  • Communication hardware, interfaces and storage

    • Signal processing systems