Prototyping retractable string-based interaction techniques for dual-display mobile devices

ABSTRACT

Accessing information on mobile and wearable devices often requires the user's visual attention, and the precise operation of virtual or physical widgets. However, these interactions may sometimes be too time-consuming and socially inappropriate. To address this, we introduce a novel input/output device that is based on the manipulation of a retractable string in a polar coordinate frame. Depending on how the user pulls the string from its enclosure--to a particular length, at a particular angle--various system features may be directly accessed. Furthermore, we present our concept for a 1D pixel array, embedded in the string that may be used as a secondary 1D display. Since it is possible to unwind the display itself and trigger functionality with a single pull, information may be accessed and presented quickly, and perceived at a glance. We present scenarios for how the string input/output device may be used in conjunc-tion with the mobile device's primary 2D display and describe our augmented reality proof-of-concept prototype.

REFERENCES

• 1: Twiddler2 by HandyKey Corporation URL: http://www.handykey.com/
• 2: Johnny Accot , Shumin Zhai, Beyond Fitts' law: models for trajectory-based HCI tasks, Proceedings of the SIGCHI conference on Human factors in computing systems, p.295-302, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258760]
• 3: Len Bass , Chris Kasabach , Richard Martin , Dan Siewiorek , Asim Smailagic , John Stivoric, The design of a wearable computer, Proceedings of the SIGCHI conference on Human factors in computing systems, p.139-146, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258634]
• 4: Oliver Bimber , Ramesh Raskar, Spatial Augmented Reality: Merging Real and Virtual Worlds, A. K. Peters, Ltd., Natick, MA, 2005
• 5: J. Callahan , D. Hopkins , M. Weiser , B. Shneiderman, An empirical comparison of pie vs. linear menus, Proceedings of the SIGCHI conference on Human factors in computing systems, p.95-100, May 15-19, 1988, Washington, D.C., United States [doi>10.1145/57167.57182]
• 6: Naomi Friedlander , Kevin Schlueter , Marilyn Mantei, Bullseye! when Fitts' law doesn't fit, Proceedings of the SIGCHI conference on Human factors in computing systems, p.257-264, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274681]
• 7: David Holman , Roel Vertegaal , Mark Altosaar , Nikolaus Troje , Derek Johns, Paper windows: interaction techniques for digital paper, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055054]
• 8: Kulik, A., Paneque, D., and Hochstrate, J., Vectorix: A Low-Tech Mechanical Tracking System, Proc. IEEE VR Workshop: Beyond Wand and Glove Based Interac-tion, 2004, pp. 25--27.
• 9: Gordon Paul Kurtenbach, The design and evaluation of marking menus, University of Toronto, Toronto, Ont., Canada, 1993
• 10: Chandra Narayanaswami , M. T. Raghunath, Designing a New Form Factor for Wearable Computing, IEEE Pervasive Computing, v.1 n.4, p.42-48, October 2002 [doi>10.1109/MPRV.2002.1158277 ]
• 11: Donald Lee Vickers, Sorcerer's apprentice: head-mounted display and wand, 1972

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  B. Hardware
  B.3 MEMORY STRUCTURES
      B.3.2 Design Styles

Keywords:
mobile computing, mobile interaction, pixel-array displays, retractable string-based input, wearable computing