research-article

DisplayObjects: prototyping functional physical interfaces on 3d styrofoam, paper or cardboard models

Authors:

Roel VertegaalAuthors Info & Claims

TEI '10: Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction

Pages 49 - 56

https://doi.org/10.1145/1709886.1709897

Published: 24 January 2010 Publication History

Abstract

This paper introduces DisplayObjects, a rapid prototyping workbench that allows functional interfaces to be projected onto real 3D physical prototypes. DisplayObjects uses a Vicon motion capture system to track the location of physical models. 3D software renditions of the 3D physical model are then texture-mapped with interactive behavior and projected back onto the physical model to allow real- time interactions with the object. We discuss the implementation of the system, as well as a selection of one and two-handed interaction techniques for DisplayObjects. We conclude with a design case that comments on some of the early design experiences with the system.

References

[1]

Avrahami, D. and Hudson, S.E. Forming Interactivity: A Tool for Rapid Prototyping of Physical Interactive Products. In Proceedings of the ACM Symposium on Designing Interactive Systems (DIS'02), pp. 141--146, 2002.

Digital Library

[2]

Bandyopadhyay, Raskar, R., and H. Fuchs. Dynamic Shader Lamps: Painting on Movable Objects. In Proceedings of In Proceedings of Eurographics Workshop on Rendering, 2001.

[3]

Coelho M., Poupyrev, I., Sadi, S., Vertegaal, R., Berzowska, J., Buechley, L., Maes, P. and Oxman, N. Programming Reality: From Transitive Materials to Organic User Interfaces (Workshop). In Proceedings of CHI 2009, ACM Press, 2009 (in press).

Digital Library

[4]

Goldstein, S., et al. Programmable matter. IEEE Computer 38, 2005, 99--101.

Digital Library

[5]

Grossman, T., Wigdor, D., and Balakrishnan, R. 2005. Multi-finger gestural interaction with 3D volumetric displays. In Proceedings of ACM SIGGRAPH 2005 Papers. ACM, Los Angelos, California, 2005, 931--931.

Digital Library

[6]

Hartmann, B., Klemmer, S.R., Bernstein, M., Abdulla, L., Burr, B., Robinson-Mosher, A., and Gee, J. 2006. Reflective physical prototyping through integrated design, test, and analysis. In Proceedings of UIST '06. ACM, New York, NY, 2006, 299--308.

Digital Library

[7]

Holman, D. and Vertegaal, R. Organic User Interfaces: Designing Computers in Any Way, Shape, or Form. Communications of the ACM, vol. 51 (6), 2008.

Digital Library

[8]

Holman, D., Vertegaal, R. and Altosaar, M. PaperWindows: Interaction Techniques for Digital Paper. In Proc. CHI 2005, ACM Press (2005), 591--599.

Digital Library

[9]

Hudson, S. and Mankoff, J. Rapid Construction of Functioning Physical Interfaces from Cardboard, Thumbtacks, Tin Foil and Masking Tape. In Proceedings of UIST'06, October 15-18, 2006, Montreux, Switzerland.

Digital Library

[10]

Ishii, H. The Tangible User Interface and its Evolution. Commun. ACM Volume 51, Issue 6, 2008, 32--36.

Digital Library

[11]

Ishii, H., and Ullmer, B. Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. In Proc. CHI 1997, ACM Press (1997), 234--241.

Digital Library

[12]

Lee, J.C., Avrahami1, D., Hudson, S.E., Forlizzi, J., Dietz, P.H., Leigh, D. The Calder Toolkit: Wired and Wireless Components for Rapidly Prototyping Interactive Devices. In Proceedings of DIS 04, Cambridge, MA, USA, 2004.

Digital Library

[13]

Lee, J.C., Dietz, P.H., Maynes-Aminzade, D., Raskar, R., Hudson, S.E. Automatic Projector Calibration with Embedded Light Sensors. In Proceedings of UIST '04, October 24-27, 2004, Santa Fe, New Mexico, USA.

Digital Library

[14]

Merrill, D., Kalanithi, J., and Maes, P. Siftables: Towards Sensor Network User Interfaces. In Proceedings of the 1st international conference on Tangible and Embedded Interaction, February 15-17, 2007, Baton Rouge, Louisiana.

Digital Library

[15]

Optimus. Optimus Maximus Keyboard, http://www.artlebedev.com/everything/optimus/, 2008.

[16]

Piper, B., Ratti, C., and Ishii, H. Illuminating Clay: A 3-D Tangible Interface for Landscape Analysis. In Proceedings of the CHI '02. ACM, Minneapolis, 2002, 355--362.

Digital Library

[17]

Prince, S., Cheok, A.D., Farbiz, F., Williamson, T., Johnson, N., Billinghurst, M., and H. Kato: 3D Live: Real Time Captured Content for Mixed Reality. ISMAR 2002, 317.

Digital Library

[18]

Raskar, R., G. Welch, and K.-L. Low. Shader Lamps: Animating Real Objects with Image-based Illumination. In Proceedings of Eurographics Workshop on Rendering, 2001.

Digital Library

[19]

Rekimoto, J. SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. In Proceedings of CHI '02. ACM, Minneapolis, 113--120.

Digital Library

[20]

Rekimoto, J., Ullmer, B., and Oba, H. 2001. DataTiles: a modular platform for mixed physical and graphical interactions. In Proceedings of CHI '01. ACM, Seattle, WA, 2001, 269--276.

Digital Library

[21]

Saakes, D.P. Material Light : Exploring Expressive Materials. In Personal and Ubiquitous Computing: Volume 10, Issue 2-3, 2006.

Digital Library

[22]

Snyder, C. Paper Prototyping: The Fast and Easy Way to Design and Refine User Interfaces. Morgan Kaufmann, 2003.

Digital Library

[23]

Villar, N. and Gellersen, H. A Malleable Control Structure for Softwired User Interfaces. In Proceedings of Tangible and Embedded Interaction (TEI'07), 2007.

Digital Library

[24]

Williams, M. Sony, Philips Unveil Flexible OLED Displays. PC World, May25th, 2007.

Cited By

Hanton OFraser MRoudaut A(2024)DisplayFab: The State of the Art and a Roadmap in the Personal Fabrication of Free-Form Displays Using Active Materials and Additive Manufacturing.Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642708(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642708
Gopsill JGiunta LGoudswaard MSnider CHicks B(2024)Data mining prototyping knowledge graphs for design process insightsJournal of Engineering Design10.1080/09544828.2024.2302746(1-27)Online publication date: 17-Jan-2024
https://doi.org/10.1080/09544828.2024.2302746
Poulin MMasclet CBoujut J(2024)Investigating the effects of spatial augmented reality on user participation in co-design sessions: A case studyComputers in Industry10.1016/j.compind.2023.104023154(104023)Online publication date: Jan-2024
https://doi.org/10.1016/j.compind.2023.104023
Show More Cited By

Index Terms

DisplayObjects: prototyping functional physical interfaces on 3d styrofoam, paper or cardboard models
1. Human-centered computing

Recommendations

DisplayObjects: functional prototyping on real objects
CHI EA '09: CHI '09 Extended Abstracts on Human Factors in Computing Systems

This video introduces DisplayObjects, a rapid prototyping workbench that allows functional displays to be projected on real 3D physical prototypes. DisplayObjects uses a Vicon motion capture system to track the location of physical models. 3D software ...
One Reality: Augmenting How the Physical World is Experienced by combining Multiple Mixed Reality Modalities
UIST '17: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

Most of our daily activities take place in the physical world, which inherently imposes physical constraints. In contrast, the digital world is very flexible, but usually isolated from its physical counterpart. To combine these two realms, many Mixed ...
Context menus for the real world: the stick-anywhere computer
CHI EA '09: CHI '09 Extended Abstracts on Human Factors in Computing Systems

In this video, we present a context-aware menu system made out of simulated digital paper. Built on the ubiquitous yellow sticky notes found in offices everywhere, our computer provides a contextual interactive paper menu that can be used to operate ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '10: Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction

January 2010

414 pages

ISBN:9781605588414

DOI:10.1145/1709886

Conference Chairs:
Marcelo Coelho
MIT Media Lab
,
Jamie Zigelbaum
MIT Media Lab, Oblong Industries
,
General Chairs:
Hiroshi Ishii
MIT Media Lab
,
Robert J.K. Jacob
Tufts University
,
Pattie Maes
MIT Media Lab
,
Program Chairs:
Thomas Pederson
IT University of Copenhagen
,
Orit Shaer
Wellesley College
,
Ron Wakkary
Simon Fraser University

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 January 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

TEI '10

Sponsor:

SIGCHI

TEI '10: Fourth International Conference on Tangible, Embedded, and Embodied Interaction

January 24 - 27, 2010

Massachusetts, Cambridge, USA

Acceptance Rates

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Sponsor:
sigchi

Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction

March 4 - 7, 2025

Bordeaux / Talence , France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

65
Total Citations
View Citations
1,409
Total Downloads

Downloads (Last 12 months)62
Downloads (Last 6 weeks)4

Reflects downloads up to 18 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hanton OFraser MRoudaut A(2024)DisplayFab: The State of the Art and a Roadmap in the Personal Fabrication of Free-Form Displays Using Active Materials and Additive Manufacturing.Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642708(1-24)Online publication date: 11-May-2024
Gopsill JGiunta LGoudswaard MSnider CHicks B(2024)Data mining prototyping knowledge graphs for design process insightsJournal of Engineering Design10.1080/09544828.2024.2302746(1-27)Online publication date: 17-Jan-2024
Poulin MMasclet CBoujut J(2024)Investigating the effects of spatial augmented reality on user participation in co-design sessions: A case studyComputers in Industry10.1016/j.compind.2023.104023154(104023)Online publication date: Jan-2024
Morosi FBecattini NCaruso GCascini G(2023)Measuring the Impact of Augmented Prototyping Systems in Co-Design ActivitiesMultimodal Technologies and Interaction10.3390/mti71101087:11(108)Online publication date: 18-Nov-2023
Jaiswal SSrinivasan V(2023)Theoretical and Empirical Perspectives on Prototypes and Prototyping in DesignDesign in the Era of Industry 4.0, Volume 210.1007/978-981-99-0264-4_71(865-876)Online publication date: 30-Jul-2023
Morosi FCaruso GBecattini NCascini G(2023)Projected Augmented Reality for Industrial Design: Challenges and OpportunitiesTowards a Smart, Resilient and Sustainable Industry10.1007/978-3-031-38274-1_6(61-73)Online publication date: 4-Aug-2023
Hsia TOkamoto SAkiyama YYamada Y(2022)One-touch calibration of hum-noise-based touch sensor for unknown users utilizing models trained by different usersROBOMECH Journal10.1186/s40648-022-00238-49:1Online publication date: 15-Dec-2022
Kim JEom HKim JKim YNoh J(2022)Real-time tunnel projection from a moving subway trainThe Visual Computer10.1007/s00371-022-02487-139:7(2711-2724)Online publication date: 27-Apr-2022
Ben Guefrech FBoujut JDekoninck ECascini G(2022)Studying interaction density in co-design sessions involving spatial augmented realityResearch in Engineering Design10.1007/s00163-022-00402-234:2(201-220)Online publication date: 8-Dec-2022
Ullmer BShaer OMazalek AHummels C(2022)Weaving Fire into FormundefinedOnline publication date: 20-Jul-2022
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten