Actuation and tangible user interfaces: the Vaucanson duck, robots, and shape displays

ABSTRACT

In the last decade, the vision of future interfaces has shifted from virtual reality to augmented and tangible user interfaces (UI) where virtual and physical (or "bits and atoms") co-exist in harmony. Recently, a growing number of designers and researchers have been taking the next logical step: creating interfaces where physical, tangible elements are not merely dynamically coupled to the digital attributes and information, but are themselves dynamic, self-reconfigurable devices that can change their physical properties depending on the state of the interfaces, the user, or the environment.A combination of the actuation, self-configuration, and tangibility can expand and enhance the design of tangible interfaces. In this paper, we present an overview of the use of actuation in user interfaces and discuss the rationality of building actuated interfaces. We then discuss actuated interfaces in detail based on our experience designing Lumen shape displays. Work on actuated interfaces is still in its infancy, projects are few and far between, so we consider this paper an invitation to discussion and hope it can help stimulate further research in this area.

REFERENCES

• 1: Aegis Hyposurface, in http://www.sial.rmit.edu.au/Projects/Aegis_Hyposurface.php.
• 2: Motoyuki Akamatsu , Sigeru Sato, A multi-modal mouse with tactile and force feedback, International Journal of Human-Computer Studies, v.40 n.3, p.443-453, March 1994 [doi>10.1006/ijhc.1994.1020 ]
• 3: Doug A. Bowman , Ernst Kruijff , Joseph J. LaViola , Ivan Poupyrev, 3D User Interfaces: Theory and Practice, Addison Wesley Longman Publishing Co., Inc., Redwood City, CA, 2004
• 4: Scott Brave , Hiroshi Ishii , Andrew Dahley, Tangible interfaces for remote collaboration and communication, Proceedings of the 1998 ACM conference on Computer supported cooperative work, p.169-178, November 14-18, 1998, Seattle, Washington, United States [doi>10.1145/289444.289491]
• 5: Grigore C. Burdea, Force and touch feedback for virtual reality, John Wiley & Sons, Inc., New York, NY, 1996
• 6: P. Buttolo , B. Hannaford, Pen-based force display for precision manipulation in virtual environments, Proceedings of the Virtual Reality Annual International Symposium (VRAIS'95), p.217, March 11-15, 1995
• 7: Angela Chang , Sile O'Modhrain , Rob Jacob , Eric Gunther , Hiroshi Ishii, ComTouch: design of a vibrotactile communication device, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, June 25-28, 2002, London, England [doi>10.1145/778712.778755]
• 8: Cholewiak, R. and C. Sherrick, A computer-controlled matrix system for presentation to skin of complex spatiotemporal pattern. Behavior Research Methods and Instrumentation, 1981. 13(5): p. 667--673.
• 9: Frey, M., 2005 Snoil, http://www.freymartin.de/blog/archives/02_sensitive_skins/.
• 10: Gibson, J., Observations on active touch. Psychological review, 1962. 69: p. 477--491.
• 11: Greyworld, Source, http://www.greyworld.org/artwork/source/. 2004.
• 12: Hurmuzlu, Y., A. Ephanov, and D. Stoianovici, Effect of a Pneumatically Driven Haptic Interface on the Perceptional Capabilities of Human Operators. Presence, 1998. 7(3): p. 290--307.
• 13: Hiroshi Ishiguro, Toward interactive humanoid robots: a constructive approach to developing intelligent robots, Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 2, p.621-622, July 15-19, 2002, Bologna, Italy [doi>10.1145/544862.544863]
• 14: Hiroo Iwata , Hiroaki Yano , Fumitaka Nakaizumi , Ryo Kawamura, Project FEELEX: adding haptic surface to graphics, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.469-476, August 2001 [doi>10.1145/383259.383314]
• 15: Kodama, S. and M. Takeno. Protrude, Flow. Proceedings of SIGGRAPH'2001 Electronic Arts and Animation Catalogue. 2001: ACM: pp. 138.
• 16: LaMotte, R. and J. Whitehouse, Tactile detection of a dot on a smooth surface: Peripherial neural events. Journal of Neurophysiology, 1986(56): p. 1109--1128.
• 17: Lerner, M., Outerspace: Reactive robotic creature. 2005 http://www.andrestubbe.com/outerspace/.
• 18: Nakatani, M., H. Kajimoto, D. Sekiguchi, N. Kawakami, and S. Tachi. 3D Form Display with Shape Memory Alloy. Proceedings ofICAT'2003. 2003: pp. 179--184.
• 19: Gian Pangaro , Dan Maynes-Aminzade , Hiroshi Ishii, The actuated workbench: computer-controlled actuation in tabletop tangible interfaces, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.572011]
• 20: Ivan Poupyrev , Shigeaki Maruyama, Tactile interfaces for small touch screens, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.217-220, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964721]
• 21: Ivan Poupyrev , Shigeaki Maruyama , Jun Rekimoto, Ambient touch: designing tactile interfaces for handheld devices, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.571993]
• 22: Ivan Poupyrev , Jun Rekimoto , Shigeaki Maruyama, TouchEngine: a tactile display for handheld devices, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/506443.506525]
• 23: Ivan Poupyrev , Makoto Okabe , Shigeaki Maruyama, Haptic feedback for pen computing: directions and strategies, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986051]
• 24: Jun Rekimoto, SmartSkin: an infrastructure for freehand manipulation on interactive surfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503397]
• 25: Riskin, J., The defecating duck, or, the ambiguous origins of artificial life. Critical Inquiry, 2003. 20(4): p. 599--633.
• 26: Summers, I., C. Chanter, A. Southall, and A. Brady. Results from a Tactile Array on the Fingertip. Proceedings of Eurohaptics'2001. 2001.
• 27: Sutherland, I. The ultimate display. Proceedings of International Federation of Information Processing. 1965: pp. 506--508.
• 28: Hiroshi Ishii , Brygg Ullmer, Tangible bits: towards seamless interfaces between people, bits and atoms, Proceedings of the SIGCHI conference on Human factors in computing systems, p.234-241, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258715]
• 29: Strandh, S.: The history of the Machine, Dorset Press, New York, 1979.
• 30: Andrew Dahley , Craig Wisneski , Hiroshi Ishii, Water lamp and pinwheels: ambient projection of digital information into architectural space, CHI 98 conference summary on Human factors in computing systems, p.269-270, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286750]
• 31: Scott Brave , Hiroshi Ishii , Andrew Dahley, Tangible interfaces for remote collaboration and communication, Proceedings of the 1998 ACM conference on Computer supported cooperative work, p.169-178, November 14-18, 1998, Seattle, Washington, United States [doi>10.1145/289444.289491]
• 32: Ivan Poupyrev , Tatsushi Nashida , Shigeaki Maruyama , Jun Rekimoto , Yasufumi Yamaji, Lumen: interactive visual and shape display for calm computing, ACM SIGGRAPH 2004 Emerging technologies, August 08-12, 2004, Los Angeles, California [doi>10.1145/1186155.1186173]
• 33: Hirschmann, D. Glowbits http://www.glowbits.com/

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Haptic I/O

Keywords:
collaboration, haptics, interaction, shape displays