skip to main content
10.5555/1671011.1671016acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesbcs-hciConference Proceedingsconference-collections
research-article

Putting the physical into the digital: issues in designing hybrid interactive surfaces

Published: 01 September 2009 Publication History

Abstract

Hybrid surfaces are interactive systems combining techniques of direct-manipulation multi-touch surface interaction with elements of tangible user interfaces (TUIs). The design space for such complex hands-on computing experiences is sufficiently broad that it can be difficult to decide when interface elements should be given either a physical or digital instantiation, and the extent to which different interface functions should be made to model real-world interactions. In this paper we present two case studies of hybrid surface systems we are developing and discuss how we have reasoned through these kinds of design decisions. From this, we derive a set of observations about properties of physical and digital elements, and offer them as a design resource.

References

[1]
Agarawala, A. & Balakrishnan, R. (2006) Keepin' It Real: Pushing the Desktop Metaphor with Physics, Piles and the Pen. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems. CHI '06. ACM, 1283--1292
[2]
Brown, E., Buxton, W. & Murtagh, K. (1990). Windows on tablets as a means of achieving virtual input devices. In Proc. of INTERACT '90, 675--681
[3]
Fishkin, K. P. (2004). A taxonomy for and analysis of tangible interfaces. Personal and Ubiquitous Computing. 8, 5, 347--358.
[4]
Fitzmaurice, G, & Buxton, W. (1997) An empirical evaluation of Graspable User Interfaces In Proc. of the SIGCHI Conference on Human Factors in Computing Systems. CHI '97. ACM, 43--50
[5]
Fitzmaurice, G, Ishii, H., & Buxton, W. (1995) Bricks: Laying the Foundations for Graspable User Interfaces In Proc. of the SIGCHI Conference on Human Factors in Computing Systems. CHI '95. ACM, 442--449
[6]
Holmquist, L., Redström, J. & Ljungstrand, P. (1999), Token-Based Access to Digital Information. In Proc. of HUC'99. 234--245
[7]
Hornecker, E. (2005) A Design Theme for Tangible Interaction: Embodied Facilitation. In Proc. of ECSCW'05, 23--43
[8]
Hornecker, E. & Buur, J. (2006). Getting a grip on tangible interaction: a framework on physical space and social interaction. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems. CHI '06. ACM, 437--446
[9]
Hurtienne, J. & Israel, J. H. (2007). Image Schemas and Their Metaphorical Extensions -- Intuitive Patterns for Tangible Interaction. In Proc. of the 1st international Conference on Tangible and Embedded interaction. TEI '07. ACM, 127--134
[10]
Hurtienne, J., Stössel, C. & Weber, K. (2009) Sad is Heavy and Happy is Light Population Stereotypes of Tangible Object Attributes. In Proc. of the 3rd international Conference on Tangible and Embedded interaction. TEI '09. ACM. 61--68
[11]
Ishii, H. & Ullmer, B. (1997) Tangible bits: Towards seamless interfaces between people, bits and atoms. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems. CHI '97. ACM, 234--241
[12]
Ishii, H. (2008). Tangible bits: beyond pixels. In Proc. of the 2nd international Conference on Tangible and Embedded interaction. TEI '08. ACM. xv-xxv.
[13]
Izadi, S., Hodges, S., Taylor, S., Rosenfeld, D. Villar, N., Butler, A., & Westhues, J. (2008) Going Beyond the Display: A Surface Technology with an Electronically Switchable Diffuser. In Proc. of the 21st Annual ACM Symposium on User interface Software and Technology. UIST '08. ACM. 269--278
[14]
Kirk, D. S., Izadi, S., Sellen, A., Taylor, S., Banks, R. & Hilliges, O. (2009) Opening up the Family Archive. Paper in submission to CSCW 2010.
[15]
Jacob, R. J., Girouard, A., Hirshfield, L. M., Horn, M. S., Shaer, O., Solovey, E. T., & Zigelbaum, J. (2008). Reality-based interaction: a framework for post-WIMP interfaces. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems. CHI '08. ACM, 201--210
[16]
Jordá, S., Geiger, G., Alonso, M., & Kaltenbrunner, M. (2007). The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces. In Proc. of the 1st international Conference on Tangible and Embedded interaction. TEI '07. ACM. 139--146
[17]
Kirk, D. & Sellen, A. (2008) On Human Remains: Excavating the Home Archive. Microsoft Technical Report. MSR-TR-2008-8
[18]
Kirk, D., Sellen, A., Rother, C., & Wood, K. (2006). Understanding photowork. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems. CHI '06. ACM, 761--770
[19]
Koleva, B., Benford, S., Kher Hui Ng & Rodden, T. (2003) A Framework for Tangible User Interfaces. In "Physical Interaction (PI03) - Workshop on Real World User Interfaces", at Mobile HCI '03
[20]
Manches, A., O'Malley, C. & Benford, S. (2009) Physical Manipulation: Evaluating the Potential for Tangible Designs. In Proc. of the 3rd international Conference on Tangible and Embedded interaction. TEI '09. ACM. 77--84
[21]
Pangaro, G., Maynes-Aminzade, D., & Ishii, H. (2002) The actuated workbench: computer-controlled actuation in tabletop tangible interfaces. In Proc. of the 15th Annual ACM Symposium on User interface Software and Technology. UIST '02. ACM. 181--190
[22]
Parkes, A., Raffle, H., & Ishii, H. (2008). Topobo in the wild: longitudinal evaluations of educators appropriating a tangible interface. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems. CHI '08. ACM, 1129--1138
[23]
Rekimoto, J., Ullmer, B., & Oba, H. (2001) DataTiles: a modular platform for mixed physical and graphical interactions. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems. CHI '01. ACM. 269--276
[24]
Sellen, A. J., Kurtenbach, G. P., & Buxton, W. (1992). The prevention of mode errors through sensory feedback. Human-Computer Interaction, Vol. 7(2), 141--164
[25]
Taylor, S., Izadi, S., Kirk, D., Harper, R., and Garcia-Mendoza, A. 2009. Turning the tables: an interactive surface for vjing. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems CHI '09. ACM, 1251--1254
[26]
Ullmer B. & Ishii H. (2000) Emerging frameworks for tangible user interfaces'. IBM Systems Journal 39(3--4), 915--931
[27]
Underkoffler, J. and Ishii, H. (1999). Urp: a luminous-tangible workbench for urban planning and design. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems. CHI '99. ACM, 386--393
[28]
Wilson, A. D., Izadi, S., Hilliges, O., Garcia-Mendoza, A., Kirk, D. (2008) Bringing Physics to the Surface. In Proc. of the 21st Annual ACM Symposium on User interface Software and Technology. UIST '08. ACM. 67--76

Cited By

View all
  • (2019)The Reality of Reality-Based InteractionACM Transactions on Computer-Human Interaction10.1145/331961726:5(1-35)Online publication date: 12-Sep-2019
  • (2018)Accessibility and tangible interaction in distributed workspaces based on multi-touch surfacesUniversal Access in the Information Society10.1007/s10209-017-0563-717:2(247-256)Online publication date: 1-Jun-2018
  • (2017)Design Directions for Media-Supported Collocated Remembering PracticesProceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3024969.3024996(21-30)Online publication date: 20-Mar-2017
  • Show More Cited By

Index Terms

  1. Putting the physical into the digital: issues in designing hybrid interactive surfaces

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    BCS-HCI '09: Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology
    September 2009
    532 pages

    Sponsors

    • British Computer Society: BCS

    In-Cooperation

    Publisher

    BCS Learning & Development Ltd.

    Swindon, United Kingdom

    Publication History

    Published: 01 September 2009

    Check for updates

    Author Tags

    1. TUI
    2. design
    3. direct-touch
    4. hybrid surfaces
    5. tangibility

    Qualifiers

    • Research-article

    Conference

    BCS HCI '09
    Sponsor:
    • British Computer Society

    Acceptance Rates

    Overall Acceptance Rate 28 of 62 submissions, 45%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)2
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 09 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2019)The Reality of Reality-Based InteractionACM Transactions on Computer-Human Interaction10.1145/331961726:5(1-35)Online publication date: 12-Sep-2019
    • (2018)Accessibility and tangible interaction in distributed workspaces based on multi-touch surfacesUniversal Access in the Information Society10.1007/s10209-017-0563-717:2(247-256)Online publication date: 1-Jun-2018
    • (2017)Design Directions for Media-Supported Collocated Remembering PracticesProceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3024969.3024996(21-30)Online publication date: 20-Mar-2017
    • (2017)TAPASJournal of Visual Languages and Computing10.1016/j.jvlc.2016.11.00239:C(66-77)Online publication date: 1-Apr-2017
    • (2016)Comparing Tangible and Multi-touch Interaction for Interactive Data Visualization TasksProceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/2839462.2839464(279-286)Online publication date: 14-Feb-2016
    • (2015)An Implementation of Tangible Interactive Mapping to Improve Adult Learning for Preparing for BushfireProceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction10.1145/2838739.2838814(545-548)Online publication date: 7-Dec-2015
    • (2014)Storied numbersProceedings of the ACM International Conference on Interactive Experiences for TV and Online Video10.1145/2602299.2602308(123-130)Online publication date: 25-Jun-2014
    • (2014)Back to tangibilityProceedings of the 2014 International Working Conference on Advanced Visual Interfaces10.1145/2598153.2598161(57-64)Online publication date: 27-May-2014
    • (2013)ObjecTopProceedings of the 2013 ACM international conference on Interactive tabletops and surfaces10.1145/2512349.2512806(255-264)Online publication date: 6-Oct-2013
    • (2013)Flights in my handsProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2470654.2481300(2175-2184)Online publication date: 27-Apr-2013
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media