Intuitive manipulation techniques for projected displays of mobile devices

ABSTRACT

Mobile devices (cellular phone, PDA, etc.) used by many people in their daily lives have so far been personal tools. Due to their multi-functionality, however, the devices have begun to be used by multiple people in co-located situations. This paper discusses near future technologies: a mobile device with a projector and intuitive manipulation techniques by using a video camera mounted on the device. It is difficult to realize a mobile device with a small and light projector that still retains the feature of mobility, so we have developed a system to project displays of mobile devices by tracking their three-dimensional positions and orientations. The proposed system called Hotaru (a firefly, in English) allows users to annotate, rotate or transfer files between multiple devices by touching their projected displays with fingers.

REFERENCES

• 1: Information and Communication in Japan 2004: http://www.johotsushintokei.soumu.go.jp/whitepaper/eng/WP2004/Chapter2-2.pdf
• 2: Integrating paper and digital information on EnhancedDesk: a method for realtime finger tracking on an augmented desk system, ACM Transactions on Computer-Human Interaction (TOCHI), v.8 n.4, p.307-322, December 2001 [doi>10.1145/504704.504706]
• 3: New York Times: For Your Viewing Pleasure, a Projector in Your Pocket http://www.nytimes.com/2004 /11/04/technology/circuits/04next.html
• 4: Helena Roeber , John Bacus , Carlo Tomasi, Typing in thin air: the canesta projection keyboard - a new method of interaction with electronic devices, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.765944]
• 5: Emanuele Trucco , Alessandro Verri, Introductory Techniques for 3-D Computer Vision, Prentice Hall PTR, Upper Saddle River, NJ, 1998
• 6: Pierre Wellner, Interacting with paper on the DigitalDesk, Communications of the ACM, v.36 n.7, p.87-96, July 1993 [doi>10.1145/159544.159630]
• 7: Zhengyou Zhang , Ying Wu , Ying Shan , Steven Shafer, Visual panel: virtual mouse, keyboard and 3D controller with an ordinary piece of paper, Proceedings of the 2001 workshop on Perceptive user interfaces, November 15-16, 2001, Orlando, Florida [doi>10.1145/971478.971522]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Keywords:
intuitive manipulation techniques, mobile device, projected display