Lucid touch: a see-through mobile device

ABSTRACT

Touch is a compelling input modality for interactive devices; however, touch input on the small screen of a mobile device is problematic because a user's fingers occlude the graphical elements he wishes to work with. In this paper, we present LucidTouch, a mobile device that addresses this limitation by allowing the user to control the application by touching the back of the device. The key to making this usable is what we call pseudo-transparency: by overlaying an image of the user's hands onto the screen, we create the illusion of the mobile device itself being semi-transparent. This pseudo-transparency allows users to accurately acquire targets while not occluding the screen with their fingers and hand. Lucid Touch also supports multi-touch input, allowing users to operate the device simultaneously with all 10 fingers. We present initial study results that indicate that many users found touching on the back to be preferable to touching on the front, due to reduced occlusion, higher precision, and the ability to make multi-finger input.

REFERENCES

• 1: Pär-Anders Albinsson , Shumin Zhai, High precision touch screen interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642631]
• 2: Azuma, R.T. (1997). A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments 6(4) (August 1997). p. 355--385.
• 3: Ravin Balakrishnan , Gordon Kurtenbach, Exploring bimanual camera control and object manipulation in 3D graphics interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.56-62, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.302991]
• 4: Patrick Baudisch , Carl Gutwin, Multiblending: displaying overlapping windows simultaneously without the drawbacks of alpha blending, Proceedings of the SIGCHI conference on Human factors in computing systems, p.367-374, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985739]
• 5: Hrvoje Benko , Andrew D. Wilson , Patrick Baudisch, Precise selection techniques for multi-touch screens, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124963]
• 6: William Buxton, A three-state model of graphical input, Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction, p.449-456, August 27-31, 1990
• 7: Buxton, W. and Myers, B.A. (1986). A study in two-handed input. Proceedings of CHI '86. p. 321--326.
• 8: Card, S.K., English, W.K., Burr, B.J. (1978). Evaluation of Mouse, Rate-controlled Isometric Joystick, Step Keys, and Text Keys for Text Selection on a CRT. Ergonomics 21(8). p. 601--613.
• 9: Paul Dietz , Darren Leigh, DiamondTouch: a multi-user touch technology, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502389]
• 10: Alan Esenther , Kathy Ryall, Fluid DTMouse: better mouse support for touch-based interactions, Proceedings of the working conference on Advanced visual interfaces, May 23-26, 2006, Venezia, Italy [doi>10.1145/1133265.1133289]
• 11: Clifton Forlines , Chia Shen, DTLens: multi-user tabletop spatial data exploration, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095055]
• 12: Clifton Forlines , Daniel Vogel , Ravin Balakrishnan, HybridPointing: fluid switching between absolute and relative pointing with a direct input device, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland [doi>10.1145/1166253.1166286]
• 13: Guiard, Y. (1987) Asymmetric Division of Labor in Human Skilled Bimanual Action: The Kinematic Chain as a Model. Journal of Motor Behavior, 19. p. 486--517.
• 14: Jefferson Y. Han, Low-cost multi-touch sensing through frustrated total internal reflection, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095054]
• 15: Hiraoka, S., Miyamoto, I., Tomimatsu, K. (2003) Behind Touch, a Text Input Method for Mobile Phones by The Back and Tactile Sense Interface. Information Processing Society of Japan, Interaction 2003. p. 131--138.
• 16: Paul Kabbash , William Buxton , Abigail Sellen, Two-handed input in a compound task, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.417-423, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191808]
• 17: Andrea Leganchuk , Shumin Zhai , William Buxton, Manual and cognitive benefits of two-handed input: an experimental study, ACM Transactions on Computer-Human Interaction (TOCHI), v.5 n.4, p.326-359, Dec. 1998 [doi>10.1145/300520.300522]
• 18: MacKenzie, I. S., Soukoreff, R. W. (2002). A model of two-thumb text entry. Proceedings of GI .02. p. 117--124.
• 19: R. L. Potter , L. J. Weldon , B. Shneiderman, Improving the accuracy of touch screens: an experimental evaluation of three strategies, Proceedings of the SIGCHI conference on Human factors in computing systems, p.27-32, May 15-19, 1988, Washington, D.C., United States [doi>10.1145/57167.57171]
• 20: Jun Rekimoto, SmartSkin: an infrastructure for freehand manipulation on interactive surfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503397]
• 21: Schilit, B., Adams, N.I., Want, R. (1994). Context-Aware Computing Applications. Proceedings of the Workshop on Mobile Computing Systems and Applications. p. 85--90.
• 22: Andrew Sears , Ben Shneiderman, High precision touchscreens: design strategies and comparisons with a mouse, International Journal of Man-Machine Studies, v.34 n.4, p.593-613, April 1991 [doi>10.1016/0020-7373(91)90037-8]
• 23: Masanori Sugimoto , Keiichi Hiroki, HybridTouch: an intuitive manipulation technique for PDAs using their front and rear surfaces, Proceedings of the 8th conference on Human-computer interaction with mobile devices and services, September 12-15, 2006, Helsinki, Finland [doi>10.1145/1152215.1152243]
• 24: Tang, A., Neustaedter, C., Greenberg, S. (2004). VideoArms: Supporting Remote Embodiment in Groupware. Video Proceedings of CSCW .04.
• 25: John C. Tang , Scott L. Minneman, VideoDraw: a video interface for collaborative drawing, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.313-320, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97302]
• 26: Brygg Ullmer , Hiroshi Ishii, The metaDESK: models and prototypes for tangible user interfaces, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.223-232, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263551]
• 27: Daniel Vogel , Patrick Baudisch, Shift: a technique for operating pen-based interfaces using touch, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240727]
• 28: David J. Ward , Alan F. Blackwell , David J. C. MacKay, Dasher—a data entry interface using continuous gestures and language models, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.129-137, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354427]
• 29: Daniel Wigdor , Darren Leigh , Clifton Forlines , Samuel Shipman , John Barnwell , Ravin Balakrishnan , Chia Shen, Under the table interaction, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland [doi>10.1145/1166253.1166294]
• 30: Andrew D. Wilson, TouchLight: an imaging touch screen and display for gesture-based interaction, Proceedings of the 6th international conference on Multimodal interfaces, October 13-15, 2004, State College, PA, USA [doi>10.1145/1027933.1027946]
• 31: Shumin Zhai , Michael Hunter , Barton A. Smith, The metropolis keyboard - an exploration of quantitative techniques for virtual keyboard design, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.119-128, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354424]
• 32: Shumin Zhai , Per-Ola Kristensson, Shorthand writing on stylus keyboard, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642630]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Design, Human Factors

Keywords:
augmented reality, bimanual input, direct touch, lucid touch, multi-touch, portable multi-touch, pseudo-transparency, transparent devices