research-article

Projected interfaces: enabling serendipitous interaction with smart tangible objects

Authors:

David Molyneaux,

Hans GellersenAuthors Info & Claims

TEI '09: Proceedings of the 3rd International Conference on Tangible and Embedded Interaction

Pages 385 - 392

https://doi.org/10.1145/1517664.1517741

Published: 16 February 2009 Publication History

Abstract

The Projected Interfaces architecture enables bi-directional user interaction with smart tangible objects. Smart objects function as both input and output devices simultaneously by cooperating with projector-camera systems to achieve a projected display on their surfaces. Tangible manipulation of the object and camera-based tracking allow interaction directly with the projected display. Such hybrid interfaces benefit both from the flexibility offered by the GUI and the intuitiveness of TUI. In this paper we present the theory behind how to consider interaction for projected interfaces with an architecture design and a proof of concept implementation using an augmented photograph album.

References

[1]

Bandyopadhyay, D., Raskar, R., and Fuchs, H., Dynamic Shader Lamps: Painting on Movable Objects. In: Proc. International Symposium on Augmented Reality (ISAR'01), New York, 2001.

Digital Library

[2]

Billinghurst, M., Kato, H., Poupyrev, I., The MagicBook, a transitional AR interface. Computers & Graphics 25: 745--753, 2001.

[3]

Butz, A., Groß, M., Krüger. A., TUISTER: a tangible UI for hierarchical structures. In Proc. 9th International Conference on Intelligent User Interfaces. Funchal, Madeira, Portugal, ACM, 2004.

Digital Library

[4]

Butz, A. and Krüger. A., Generalized Peephole Metaphor for Augmented Reality and Instrumented Environments. In Proc. International Workshop on Software Technology for Augmented Reality Systems (STARS), Tokyo, Japan, 2003

[5]

Decker, C., Krohn, A., Beigl, M., Zimmer, T., The Particle Computer System, IPSN Track on Sensor Platform, Tools and Design Methods for Networked Embedded Systems (SPOTS), In Proc: The ACM/IEEE 4th International Conference on Information Processing in Sensor Networks (IPSN05), pp. 443--448, Los Angeles, April 2005

Digital Library

[6]

Ehnes, J., Hirota, K., and Hirose, M., Projected Augmentation - Augmented Reality using Rotatable Video Projectors. In Proc. International Symposium on Mixed and Augmented Reality (ISMAR'04), September-October 2004, Arlington, VA, USA, 2004.

Digital Library

[7]

Fischler, M. A. and Bolles R. C., Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6): 381--395, 1981

Digital Library

[8]

Fujii, K., Grossberg, M. D., Nayar, S. K., A Projector-Camera System with Real-Time Photometric Adaptation for Dynamic Environments. In Proc: The 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1, 2005.

Digital Library

[9]

Ishii, H., Mazalek, A., Lee, J., Bottles as a minimal interface to access digital information. In CHI 2001 Extended Abstracts, ACM Press 2001, pp. 187--188.

Digital Library

[10]

Lee, J. C., Hudson, S. E., Summet, J. W., Dietz, P. H., Moveable Interactive Projected Displays Using Projector Based Tracking, In Proc. ACM Symposium on User Interface Software and Technology (UIST), pp. 63--72, Seattle, WA. October 23--26, 2005.

Digital Library

[11]

Levas, A., Pinhanez, C., Pingali, G., Kjeldsen, R., Podlaseck, M., Sukaviriya, N., An Architecture and Framework for Steerable Interface Systems. In Proc. UbiComp 2003: Ubiquitous Computing, Springer LNCS, Seattle, Washington, USA, 2003.

[12]

Lowe, D., SIFT: Distinctive image features from scale invariant keypoints, In International Journal of Computer Vision (IJCV) 60(2):91--110, 2004.

Digital Library

[13]

Molyneaux, D., Gellersen, H., Kortuem, G., and Schiele, B., Cooperative Augmentation of Smart Objects with Projector-Camera Systems. In Proc. UbiComp 2007: Ubiquitous Computing, Springer LNCS, vol. 4717, pp. 501--518, 2007.

Digital Library

[14]

Molyneaux, D., Gellersen, H. and Schiele, B., Vision-Based Detection of Mobile Smart-Objects. In Proc: 3rd IEEE Euro Conference on Smart Sensing and Context (EuroSSC), Zurich, Switzerland, 29--31 October 2008.

Digital Library

[15]

Raskar, R., Beardsley, P., Van Baar, J., Wang, Y., Dietz, P., Lee, J., Leigh, D., Willwatcher, T., RFIG Lamps: Interacting with a Self-Describing World via Photosensing Wireless Tags and Projectors, In Proc. SIGGRAPH 2004, Los Angeles, USA.

Digital Library

[16]

Schmidt, A., Strohbach, M., Van Laerhoven, K. and Gellersen, H. W., Ubiquitous Interaction - Using Surfaces in Everyday Environments as Pointing Devices, 7th ERCIM Workshop "User Interfaces For All", 23--25 October, 2002.

Digital Library

[17]

Strohbach, M., Gellersen, H.-W., Kortuem, G., and Kray, C., Cooperative Artefacts: Assessing Real World Situations with Embedded Technology. In Proc. Ubicomp 2004: Ubiquitous Computing, Springer LNCS, vol. 3205, pp. 250--267, 2004.

[18]

Summet J., and Sukthankar, R., Tracking Locations of Moving Hand-held Displays Using Projected Light, In Proc. Pervasive 2005, Munich, Germany.

Digital Library

[19]

Terrenghi, L., Kranz, M., Holleis P., Schmidt, A., A cube to learn: a tangible user interface for the design of a learning appliance, Personal and Ubiquitous Computing Journal 10(2--3): 153--158, 2006.

Digital Library

[20]

Wellner, P., "Interacting with paper on the DigitalDesk." Commun. ACM 36(7): 87--96, 1993.

Digital Library

[21]

Wu, C-S., Robinson, S., Mazalek, A., Turning the page on the digital annotation of physical books, In Proc: TEI' 08, Bonn, Germany, 18--20 February 2008.

Digital Library

Cited By

Zhou QSyiem BLi BGoncalves JVelloso E(2024)Reflected RealityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314317:4(1-28)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631431
Angelini LMugellini EAbou Khaled OCouture N(2018)Internet of Tangible Things (IoTT): Challenges and Opportunities for Tangible Interaction with IoTInformatics10.3390/informatics50100075:1(7)Online publication date: 25-Jan-2018
https://doi.org/10.3390/informatics5010007
Sefidgar YWeng THarvey HElliott SCakmak M(2018)RobotISTProceedings of the 2018 ACM Symposium on Spatial User Interaction10.1145/3267782.3267921(141-149)Online publication date: 13-Oct-2018
https://dl.acm.org/doi/10.1145/3267782.3267921
Show More Cited By

Recommendations

Cooperative augmentation of mobile smart objects with projected displays
Special issue on interaction with smart objects, Special section on eye gaze and conversation

Sensors, processors, and radios can be integrated invisibly into objects to make them smart and sensitive to user interaction, but feedback is often limited to beeps, blinks, or buzzes. We propose to redress this input-output imbalance by augmentation ...
Vision-based projected tabletop interface for finger interactions
HCI'07: Proceedings of the 2007 IEEE international conference on Human-computer interaction

We designed and implemented a vision-based projected table-top interface for finger interaction. The system offers a simple and quick setup and economic design. The projection onto the tabletop provides more comfortable and direct viewing for users, and ...
Vision-Based Projected Tabletop Interface for Finger Interactions
Human–Computer Interaction
Abstract
We designed and implemented a vision-based projected tabletop interface for finger interaction. The system offers a simple and quick setup and economic design. The projection onto the tabletop provides more comfortable and direct viewing for users,...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

TEI '09: Proceedings of the 3rd International Conference on Tangible and Embedded Interaction

February 2009

407 pages

ISBN:9781605584935

DOI:10.1145/1517664

Conference Chairs:
Nicolas Villar
Microsoft Research Cambridge, UK
,
Shahram Izadi
Microsoft Research Cambridge, UK
,
Program Chairs:
Mike Fraser
University of Bristol, UK
,
Steve Benford
University of Nottingham, UK

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Microsoft Research (USA)
Microsoft Research Cambridge (UK)
Nokia (Finland)
Microsoft Hardware (USA)

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 February 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

TEI09

Sponsor:

TEI09: 3rd International Conference on Tangible and Embedded Interaction

February 16 - 18, 2009

Cambridge, United Kingdom

Acceptance Rates

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
930
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhou QSyiem BLi BGoncalves JVelloso E(2024)Reflected RealityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314317:4(1-28)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631431
Angelini LMugellini EAbou Khaled OCouture N(2018)Internet of Tangible Things (IoTT): Challenges and Opportunities for Tangible Interaction with IoTInformatics10.3390/informatics50100075:1(7)Online publication date: 25-Jan-2018
https://doi.org/10.3390/informatics5010007
Sefidgar YWeng THarvey HElliott SCakmak M(2018)RobotISTProceedings of the 2018 ACM Symposium on Spatial User Interaction10.1145/3267782.3267921(141-149)Online publication date: 13-Oct-2018
https://dl.acm.org/doi/10.1145/3267782.3267921
Momeni AMcNamara DFernaeus YMcMillan DJonsson MGirouard ATholander J(2018)MODProceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3173225.3173254(460-469)Online publication date: 18-Mar-2018
https://dl.acm.org/doi/10.1145/3173225.3173254
Schnelle-Walka DLimonad LGrosse-Puppendahl TLanir JMüller FMecella MLuyten KKuflik TBrdiczka OMühlhäuser MNichols JMahmud JO'Donovan JConati CZancanaro M(2016)SCWTCompanion Publication of the 21st International Conference on Intelligent User Interfaces10.1145/2876456.2882849(3-5)Online publication date: 7-Mar-2016
https://dl.acm.org/doi/10.1145/2876456.2882849
Schnelle-Walka DMühlhäuser MRadomski SBrdiczka OHuber JLuyten KGrosse-Puppendahl TBrdiczka OChau PCarenini GPan SKristensson P(2015)SmartObjectsProceedings of the 20th International Conference on Intelligent User Interfaces10.1145/2678025.2716269(453-454)Online publication date: 18-Mar-2015
https://dl.acm.org/doi/10.1145/2678025.2716269
Domingo FCataneo ACortés FCastillo O(2014)Usando el contexto común de los interlocutores para permitir redes de comunicación no intrusivasIberian Journal of Information Systems and Technologies10.4304/risti.e1.77-89Online publication date: 1-Mar-2014
https://doi.org/10.4304/risti.e1.77-89
Wirtz HRüth JSerror MBitsch Link JWehrle KGerla MPassarella A(2014)Opportunistic interaction in the challenged internet of thingsProceedings of the 9th ACM MobiCom workshop on Challenged networks10.1145/2645672.2645679(7-12)Online publication date: 7-Sep-2014
https://dl.acm.org/doi/10.1145/2645672.2645679
Schnelle-Walka DHuber JRadomski SBrdiczka OLuyten KMühlhäuser MKuflik TStock OChai JKrüger A(2014)SmartObjectsCompanion Proceedings of the 19th International Conference on Intelligent User Interfaces10.1145/2559184.2559940(45-46)Online publication date: 24-Feb-2014
https://dl.acm.org/doi/10.1145/2559184.2559940
Huber J(2014)A Research Overview of Mobile Projected User InterfacesInformatik-Spektrum10.1007/s00287-014-0819-z37:5(464-473)Online publication date: 24-Jun-2014
https://doi.org/10.1007/s00287-014-0819-z
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten