skip to main content
10.1145/1095034.1095045acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
Article

Moveable interactive projected displays using projector based tracking

Published: 23 October 2005 Publication History

Abstract

Video projectors have typically been used to display images on surfaces whose geometric relationship to the projector remains constant, such as walls or pre-calibrated surfaces. In this paper, we present a technique for projecting content onto moveable surfaces that adapts to the motion and location of the surface to simulate an active display. This is accomplished using a projector based location tracking techinque. We use light sensors embedded into the moveable surface and project low-perceptibility Gray-coded patterns to first discover the sensor locations, and then incrementally track them at interactive rates. We describe how to reduce the perceptibility of tracking patterns, achieve interactive tracking rates, use motion modeling to improve tracking performance, and respond to sensor occlusions. A group of tracked sensors can define quadrangles for simulating moveable displays while single sensors can be used as control inputs. By unifying the tracking and display technology into a single mechanism, we can substantially reduce the cost and complexity of implementing applications that combine motion tracking and projected imagery.

References

[1]
Badyopadhyay, D., Raskar, R., Fuchs, H., "Dynamic Shader Lamps: Painting on Real Objects." IEEE ACM Int. Symposium on Augmented Reality (ISAR), New York, 2001.
[2]
Baudisch, P., Good, N., and Stewart, P. "Focus Plus Context Screens: Combining Display Technology with Visualization Techniques." In proceedings of ACM UIST '01, Orlando, FL, November 2001, pp.31--40.
[3]
Ben-Joseph, E., Ishii, H., Underkoffler, J., Piper, B., and Yeung, L. "Urban Simulation and the Luminous Planning Table: Bridging the Gap between the Digital and the Tangible." In Journal of Planning in Education and Research, Volume 21, pp.195--202.
[4]
Bier, E., et al., "Toolglass and Magic Lenses: The Seethrough Interface." In proceedings of ACM SIGGRAPH 1993, Anaheim, CA., Aug. 1993, pp. 73--80
[5]
Cotting, D.; Naef, M.; Gross, M.; Fuchs, H., "Embedding Imperceptible Patterns into Projected Images for Simultaneous Acquisition and Display." Third IEEE and ACM International Symposium on Mixed and Augmented Reality, 02-05 Nov. 2004 Page(s):100--109.
[6]
Hinckley, K., "Bumping Objects Together as a Semantically Rich Way of Forming Connections between Ubiquitous Devices." UbiComp 2003 formal video program.
[7]
Hinckley, K., Ramos, G., Guimbretiere, F., Baudisch, P., Smith, M., "Stitching: Pen Gestures that Span Multiple Displays." In Proceedings of ACM Advanced Visual Interfaces (AVI 2004).
[8]
Ishii, H., and B. Ullmer. "Tangible bits: towards seamless interfaces between people, bits and atoms." In proceedings of ACM CHI'97, pp. 234--241.
[9]
Kjeldsen, R., Levas, A., Pinhanez, C., "Dynamically Reconfigurable Vision-Based User Interfaces" In 3rd International Conference on Vision Systems (ICVS'03). Graz, Austria. April 2003.
[10]
Lee, J., Dietz, P., Aminzade, D., and Hudson, S. "Automatic Projector Calibration using Embedded Light Sensors", In Proceedings of ACM UIST '04. October 2004.
[11]
Pinhanez, C. "The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces." In proceedings of Ubiquitous Computing 2001.
[12]
Raskar, R.; Beardsley, P.; van Baar, J.; Wang, Y.; Dietz, P.H.; Lee, J.; Leigh, D.; Willwacher, T., "RFIG Lamps: Interacting with a Self-Describing World via Photosensing Wireless Tags and Projectors." In proceedings of ACM SIGGRAPH. August 2004.
[13]
Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., and Fuchs, H. "The office of the future: A unified approach to image-based modeling and spatially immersive displays." In proceedings of ACM SIGGRAPH '98. ACM Press, 1998.
[14]
Raskar, R., Welch, G., and Low, K.L. "Shader Lamps: Animating real objects with image-based illumination." In proceedings of Eurographics Workshop on Rendering, 2001.
[15]
Rekimoto, J., Saitoh, M., "Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments." CHI'99, pp.378--385.
[16]
Streitz, N.A., Geibler, J., Holmer, T., Konomi, S., Muller-Tomfelde, C., Reischl, W., Rexroth, P., P. Seitz, R., Steinmetz, "i-LAND: An interactive Landscape for Creativity and Innovation." In proceedings of ACM CHI'99, pp.120--127.
[17]
Summet, J., Sukthankar, R., "Tracking Locations of Moving Hand-held Displays Using Projected Light." In proceedings of Pervasive 2005. Munich, Germany. pp 37--46
[18]
Sukthankar, R., Cham, T., and Sukthankar, G. "Dynamic Shadow Elimination for Multi-Projector Displays." Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2001.
[19]
Ullmer, B., Ishii, H., "The metaDESK: models and prototypes for tangilble user interfaces." Proceedings of ACM UIST '97. October 1997.
[20]
Yotsukura, T. et al.,"Hyper Mask - Talking Head Projected onto Real Object". The Visual Computer, vol. 18(2):111--120, 2002
[21]
Yoder, L. "The Digital Display Technology of the Future." Texas Instrument white paper library, (www.dlp.com). Presented at Infocomm, 1997.
[22]
Zhang, Z., Wu, Y., Shan, Y., and Shafer, S., "Visual panel: virtual mouse, keyboard and 3d controller with an ordinary piece of paper." In Proceedings of the 2001 workshop on Perceptive User Interfaces. ACM Press, 2001.

Cited By

View all
  • (2022)Enabling Tangible Interaction on Non-touch Displays with Optical Mouse Sensor and Visible Light CommunicationProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517666(1-14)Online publication date: 29-Apr-2022
  • (2021)Dynamic DecalsProceedings of the ACM on Human-Computer Interaction10.1145/34885385:ISS(1-27)Online publication date: 5-Nov-2021
  • (2020)WATouCH: Enabling Direct Input on Non-touchscreen Using Smartwatch's Photoplethysmogram and IMU Sensor FusionProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376198(1-10)Online publication date: 21-Apr-2020
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
UIST '05: Proceedings of the 18th annual ACM symposium on User interface software and technology
October 2005
270 pages
ISBN:1595932712
DOI:10.1145/1095034
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2005

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. augmented reality
  2. physical interaction
  3. projector based tracking
  4. simulated displays

Qualifiers

  • Article

Conference

UIST05

Acceptance Rates

UIST '05 Paper Acceptance Rate 31 of 159 submissions, 19%;
Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25
The 38th Annual ACM Symposium on User Interface Software and Technology
September 28 - October 1, 2025
Busan , Republic of Korea

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)28
  • Downloads (Last 6 weeks)3
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Enabling Tangible Interaction on Non-touch Displays with Optical Mouse Sensor and Visible Light CommunicationProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517666(1-14)Online publication date: 29-Apr-2022
  • (2021)Dynamic DecalsProceedings of the ACM on Human-Computer Interaction10.1145/34885385:ISS(1-27)Online publication date: 5-Nov-2021
  • (2020)WATouCH: Enabling Direct Input on Non-touchscreen Using Smartwatch's Photoplethysmogram and IMU Sensor FusionProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376198(1-10)Online publication date: 21-Apr-2020
  • (2020)ICS-Zooids - An Experimental Testbed for Cooperative Control StrategiesIFAC-PapersOnLine10.1016/j.ifacol.2020.12.264053:2(9734-9739)Online publication date: 2020
  • (2019)Creencias de profesores en formación sobre el uso de Pizarras interactivas de bajo costoCiencia, Docencia y Tecnología10.33255/3058/479Online publication date: 11-Mar-2019
  • (2019)PILC Projector: Image Projection With Pixel-Level Infrared Light CommunicationIEEE Access10.1109/ACCESS.2019.29500687(160768-160778)Online publication date: 2019
  • (2018)Depth based movable display using projector Kinect systemProceedings of the 12th International Conference on Distributed Smart Cameras10.1145/3243394.3243691(1-6)Online publication date: 3-Sep-2018
  • (2018)Tracking of multiple planar projection boards for interactive mixed-reality applicationsMultimedia Tools and Applications10.1007/s11042-017-5313-677:13(17457-17487)Online publication date: 1-Jul-2018
  • (2017)A Shadow Cursor for Calibrating Screen Coordinates of Tabletop Displays and Its EvaluationIEICE Transactions on Information and Systems10.1587/transinf.2016EDP7331E100.D:6(1271-1279)Online publication date: 2017
  • (2017)ThirdLightProceedings of the 14th European Conference on Visual Media Production (CVMP 2017)10.1145/3150165.3150169(1-10)Online publication date: 11-Dec-2017
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media