Design by physical composition for complex tangible user interfaces

ABSTRACT

In this paper, we present a novel approach to create devices with tangible user interfaces by physical com-position. While the separation of the user interface from the application logic has a long tradition in software engineering, for products with tangible user interfaces there is no equivalent approach that realizes a true separation and flexible combination of interface components, underlying technology, and software parts. We propose a novel concept that is based on an inner Core for the basic technical and software platform of a product and an outer Shell that builds a flexible and ex-changeable tangible user interface from passive components. Using vision-based tracking, we can realize a clear separation between the components. No wiring is necessary. This paper introduces our novel approach and presents a first working prototype as well as initial results from its application in a design workshop.

References

1. Akaoka, E., Ginn, T., and Vertegaal, R. DisplayObjects: Prototyping functional physical interfaces on 3D styrofoam, paper or cardboard models. In Proc. of TEI '10. ACM (2010), 49--56.
2. Greenberg, S. and Fitchett, C. Phidgets: easy development of physical interfaces through physical widgets. In Proc. of UIST 01. ACM (2001), 209--218.
3. Hill, R. D. The abstraction-link-view paradigm: using constraints to connect user interfaces to applications. In Proc. of CHI '92. ACM (1992), 335--342.
4. Hudson, S. E. and Mankoff, J. Rapid construction of functioning physical interfaces from cardboard, In Proc. of UIST 06. ACM (2006), 289--298.
5. Ishii, H. and Ullmer, B. Tangible bits: Towards seamless interfaces between people, bits and atoms. In Proc. of CHI 97. ACM (1997), 234--241.
6. Kaltenbrunner, M. and Bencina, R. reacTIVision: a computer-vision framework for table-based tangible interaction. In Proc. of TEI '07. ACM (2007), 69--74.
7. Kato, H., Billinghurst, M. Marker Tracking and HMD Calibration for a video-based Augmented Reality Conferencing System. In Proc. IWAR 99. San Francisco, USA (1999).
8. Klemmer, S. R., Li, J., Lin, J., and Landay, J. A. Papier-Mache: toolkit support for tangible input. In Proc. of CHI '04. ACM (2004), 399--406.
9. Sankaran, R., Ullmer, B., Ramanujam, J., Kallakuri, K., Jandhyala. S., Toole, C., and Laan, C. Decoupling interaction hardware design using libraries of reusable electronics. In Proc. of TEI 09. ACM (2009), 331--337.

Index Terms

• Applied computing

  • Operations research

    • Consumer products

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Touch screens

  • Interaction design

    • Interaction design process and methods

      • Interface design prototyping