MagiWrite: towards touchless digit entry using 3D space around mobile devices

ABSTRACT

In this work, we present a new approach for text (mainly digit) entry based on digit shaped gestures created in 3D space around a mobile device. Some new mobile devices such as Apple iPhone 3GS and Google Android are equipped with magnetic (compass) sensor. The main idea is to influence the magnetic sensor using a magnet taken in hand. The user draws (writes) digits in the 3D space around the device using the magnet taken in hand. Movement of the magnet changes temporal pattern of magnetic field around the device which is sensed and registered by the magnetic (compass) sensor. The registered pattern is then compared against already recorded templates for different digits. Such a text (digit) entry approach can be especially useful for small mobile devices in which it is hard to operate small buttons or touch screen. Using our technique, the text entry space extends beyond physical boundaries of the device. A demonstrator for this approach is implemented on Apple iPhone 3GS platform. It demonstrates registering a few templates for different digits, and recognizing digits written in the space around the device

References

1. Myers, C. S., and Rabiner, L. R., A Comparative Study of Several Dynamic Time-Warping Algorithms for Connected Word Recognition, The Bell System Technical Journal, 60 (7): 1389:1409, September 1981.
2. Starner, T. and Auxier, J. and Ashbrook, D. and Gandy, M, The gesture pendant: A self-illuminating, wearable, infrared computer vision system for home automation control and medical monitoring, International Symposium on Wearable Computing, 2000, pp. 87--94.
3. Kratz, S., Rohs, M. HoverFlow: expanding the design space of around-device interaction. In Proc. of the 11th International Conference on Human Interaction with Mobile Devices and Services, Sep. 2009, Bonn, Germany.
4. Hinckley, K., Pierce, J., Sinclair, M., and Horvitz, E. Sensing techniques for mobile interaction. In Proc. of UIST '00. ACM, pp. 91--100.
5. Butler, A., Izadi, S., and Hodges, S. 2008. SideSight: Multi-"touch" interaction around small devices. In Proc. of UIST'08. ACM, 201--204.
6. Howard, B. and Howard, M.G.: Ubiquitous Computing Enabled by Optical Reflectance Controller. Whitepaper. Lightglove, Inc., http://lightglove.com/WhitePaper.htm. (Visited on 25.06.2009).
7. Baudisch, P. and Chu, G. Back-of-device interaction allows creating very small touch devices. In Proc. of CHI '09.
8. Metzger, C., Anderson, M., and Starner, T. 2004. FreeDigiter: A Contact-Free Device for Gesture Control. In Proc. of the Eighth international Symposium on Wearable Computers. ISWC. IEEE Computer Society, 18--21.
9. Theremin, L.S. The Design of a Musical Instrument Based on Cathode Relays. Reprinted in Leonardo Music J., No. 6, 1996, 49--50.
10. Smith, J., White, T., Dodge, C., Paradiso, J., Gershenfeld, N., and Allport, D. 1998. Electric Field Sensing For Graphical Interfaces. IEEE Comput. Graph. Appl. 18, 3 (May. 1998), 54--60.

Index Terms

• Hardware

  • Communication hardware, interfaces and storage

    • Signal processing systems