skip to main content
10.1145/1866218.1866229acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
demonstration

OnObject: gestural play with tagged everyday objects

Published: 03 October 2010 Publication History

Abstract

Many Tangible User Interface (TUI) systems employ sensor-equipped physical objects. However they do not easily scale to users' actual environments; most everyday objects lack the necessary hardware, and modification requires hardware and software development by skilled individuals. This limits TUI creation by end users, resulting in inflexible interfaces in which the mapping of sensor input and output events cannot be easily modified reflecting the end user's wishes and circumstances. We introduce OnObject, a small device worn on the hand, which can program physical objects to respond to a set of gestural triggers. Users attach RFID tags to situated objects, grab them by the tag, and program their responses to grab, release, shake, swing, and thrust gestures using a built-in button and a microphone. In this paper, we demonstrate how novice end users including preschool children can instantly create engaging gestural object interfaces with sound feedback from toys, drawings, or clay.

Supplementary Material

JPG File (de168-chung.jpg)
M4V File (de168-chung.m4v)

References

[1]
}}Polynor, R. 1995. The Hand That Rocks the Cradle. I.D., May/June 1995, 60--65.
[2]
}}Ishii, H., Mazalek, A., and Lee, J. Bottles as a minimal interface to access digital information. CHI '01, 187--18.
[3]
}}Ryokai, K., Marti, S., and Ishii, H. I/O brush: drawing with everyday objects as ink. CHI '04, 303--310.
[4]
}}Jorda, S., Geiger, G., Alonso, M., and Kaltenbrunner, M. 2007. The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces. TEI '07, 139--146.
[5]
}}Katsumoto, Y., Inakage, M. Amagatana. ACM MULTIMEDIA '07, 361--362.
[6]
}}Raffle, H., Vaucelle, C., Wang, R., and Ishii, H. 2007. Jabberstamp: embedding sound and voice in traditional drawings. IDC '07, 137--144.
[7]
}}MITes and Wockets http://web.mit.edu/wockets.
[8]
}}Feldman, A., Tapia, E. M., Sadi, S., Maes, P., and Schmandt, C. (2005). ReachMedia: On-the-move interaction with everyday objects. ISWC 2005, 52--59.
[9]
}}Berlin, E., Liu, J., van Laerhoven, K., Schiele, B. Coming to grips with the objects we grasp: detecting interactions with efficient wrist-worn sensors. TEI '10. 57--64.
[10]
}}Hartmann, B., Abdulla, L., Mittal, M., and Klemmer, S. R. (2007). Authoring sensor-based interactions by demonstration with direct manipulation and pattern recognition. CHI '07, 145--15.
[11]
}}Hudson, S., Mankoff, J. Rapid construction of functioning physical interfaces from cardboard, thumbtacks, tin foil and masking tape. UIST '06. 289--298.
[12]
}}Dey, A. K., Hamid, R., Beckmann, C., Li, I., and Hsu, D. (2004). a CAPpella: programming by demonstration of context-aware applications. CHI '04, 33--40.
[13]
}}Raffle, H. S., Parkes, A. J., and Ishii, H. Topobo: a constructive assembly system with kinetic memory. CHI '04, 647--65.
[14]
}}Vaucelle, C. and Ishii, H. Picture this!: film assembly using toy gestures. UbiComp '08, 350--35.
[15]
}}Zhang, H. and Hartmann, B. Building upon everyday play. CHI '07, 2019--2024.

Cited By

View all
  • (2024)Do You Need to Touch? Exploring Correlations between Personal Attributes and Preferences for Tangible Privacy MechanismsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642863(1-23)Online publication date: 11-May-2024
  • (2022)Body-Centric NFC: Body-Centric Interaction with NFC Devices Through Near-Field Enabled ClothingProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3534569(1626-1639)Online publication date: 13-Jun-2022
  • (2021)PlushPal: Storytelling with Interactive Plush Toys and Machine LearningProceedings of the 20th Annual ACM Interaction Design and Children Conference10.1145/3459990.3460694(236-245)Online publication date: 24-Jun-2021
  • Show More Cited By

Index Terms

  1. OnObject: gestural play with tagged everyday objects

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UIST '10: Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology
    October 2010
    126 pages
    ISBN:9781450304627
    DOI:10.1145/1866218

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 03 October 2010

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. end user programming
    2. gestural object interfaces
    3. tangible interfaces
    4. ubiquitous computing

    Qualifiers

    • Demonstration

    Conference

    UIST '10

    Acceptance Rates

    Overall Acceptance Rate 355 of 1,733 submissions, 20%

    Upcoming Conference

    UIST '25
    The 38th Annual ACM Symposium on User Interface Software and Technology
    September 28 - October 1, 2025
    Busan , Republic of Korea

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)11
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 09 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Do You Need to Touch? Exploring Correlations between Personal Attributes and Preferences for Tangible Privacy MechanismsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642863(1-23)Online publication date: 11-May-2024
    • (2022)Body-Centric NFC: Body-Centric Interaction with NFC Devices Through Near-Field Enabled ClothingProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3534569(1626-1639)Online publication date: 13-Jun-2022
    • (2021)PlushPal: Storytelling with Interactive Plush Toys and Machine LearningProceedings of the 20th Annual ACM Interaction Design and Children Conference10.1145/3459990.3460694(236-245)Online publication date: 24-Jun-2021
    • (2021)NFCSense: Data-Defined Rich-ID Motion Sensing for Fluent Tangible Interaction Using a Commodity NFC ReaderProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445214(1-14)Online publication date: 6-May-2021
    • (2018)Co-Designing Wearable Technology Together With Visually Impaired ChildrenWearable Technologies10.4018/978-1-5225-5484-4.ch016(314-332)Online publication date: 2018
    • (2017)An App-Based Authoring System for Personalized Sensory Stimulation of Children With Developmental DisabilitiesIEEE Access10.1109/ACCESS.2017.27121235(10583-10593)Online publication date: 2017
    • (2017)Co-designing together with Persons with Visual ImpairmentsMobility of Visually Impaired People10.1007/978-3-319-54446-5_14(411-434)Online publication date: 22-Aug-2017
    • (2016)Co-Designing Wearable Technology Together with Visually Impaired ChildrenInternational Journal of Mobile Human Computer Interaction10.4018/IJMHCI.20161001048:4(68-84)Online publication date: 1-Oct-2016
    • (2016)VRSurusProceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems10.1145/2851581.2892290(2454-2461)Online publication date: 7-May-2016
    • (2016)PERVASIVE COMPUTING TO SUPPORT INDIVIDUALS WITH COGNITIVE DISABILITIESWireless Computing in Medicine10.1002/9781118993620.ch6(137-185)Online publication date: Jul-2016
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media