skip to main content
10.1145/1864349.1864391acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
research-article

Augmenting on-screen instructions with micro-projected guides: when it works, and when it fails

Published: 26 September 2010 Publication History

Abstract

We present a study that evaluates the effectiveness of augmenting on-screen instructions with micro-projection for manual task guidance unlike prior work, which replaced screen instructions with alternative modalities (e.g., head-mounted displays). In our study, 30 participants completed 10 trials each of 11 manual tasks chosen to represent a set of common task-components (e.g., cutting, folding) found in many everyday activities such as crafts, cooking, and hobby electronics. Fifteen participants received only on-screen instructions, and 15 received both on-screen and micro-projected instructions. In contrast to prior work, which focused only on whole tasks, our study examines the benefit of augmenting common task instructions. The augmented instructions improved participants' performance overall; however, we show that in certain cases when projected guides and physical objects visually interfered, projected elements caused increased errors. Our results demonstrate that examining effectiveness at an instruction level is both useful and necessary, and provide insight into the design of systems that help users perform everyday tasks.

Supplementary Material

JPG File (p203-rosenthal.jpg)
MP4 File (p203-rosenthal.mp4)

References

[1]
}}Anderson, J. R., Corbett, A. T., Koedinger, K. R., Pelletier, R., Cognitive tutors: lessons learned. Journal of the Learning Sciences, 4, 2 (1995), 167--207.
[2]
}}Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., Macintyre, B. Recent advances in augmented reality. Computer Graphics and Applications, IEEE Press, 21, 6(2001), 34--47.
[3]
}}Baird, K.M., Barfield, W., Evaluating the effectiveness of augmented reality displays for a manual assembly task. Virtual Reality, 4, 4 (1999), 250--259.
[4]
}}Dunston, P.S., Shin, D. H., Key areas and issues for augmented reality applications on construction sites. In Mixed Reality in Architecture, Design, and Construction 2009, Springer (2009). 157--170.
[5]
}}Feiner, S., Macintyre, B., Seligmann, D., Knowledge-based augmented reality. Communications of the ACM, 36, 7 (1993), 53--62.
[6]
}}Fletcher-Flinn, C. and Gravatt, B. The efficacy of computer assisted instruction (CAI): a meta-analysis. Journal of Educational Computing Research, 12, 3 (1995), 219--242.
[7]
}}Fussell, S.R., Setlock, L. D., Yang, J., Ou, J., Mauer, E., Kramer, A. D. I., Gestures over video streams to support remote collaboration on physical tasks. Human-Computer Interaction, 19, 3 (2004), 273--309.
[8]
}}Gergle, D., Kraut, R.E., and Fussell, S.R. (2004). Action as language in a shared visual space. In Proc. CSCW 2004, ACM Press (2004), 487--496.
[9]
}}Ju, W., Bonanni, L., Fletcher, R., Hurwitz, R., Judd, T., Post, R., Reynolds, M., and Yoon, J., Origami Desk: integrating technological innovation and human-centric design. In Proc DIS 2002, ACM Press (2002), 399--405.
[10]
}}Kane, S.K., Avrahami, D., Wobbrock, J. O., Harrison, B., Rea, A., Phillipose, M., LaMarca, A., Bonfire: a nomadic system for hybrid laptop-tabletop interaction. In Proc. UIST 2009, ACM Press (2009), 129--138.
[11]
}}Kirk, D., Fraser, D. S., Comparing remote gesture technologies for supporting collaborative physical tasks. In Proc. CHI 2006, ACM Press (2006), 1191--1200.
[12]
}}Kirk, D., Rodden, T., Fraser, D. S., Turn it this way: grounding collaborative action with remote gesture. In Proc. CHI 2007, ACM Press (2007), 1039--1048.
[13]
}}Kraut, R. E., Miller, M. D. & Siegel, J. (1996). Collaboration in performance of physical tasks: effects on outcomes and communication. In Proc. CSCW 1996, ACM Press (1996), 57--66.
[14]
}}Motokawa, Y., Saito, H., Support system for guitar playing using augmented reality display. In Proc. ISMAR 2006, IEEE Press (2006), 243--244.
[15]
}}Neumann, U., Majoros, A., Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance. In Proc. Virtual Reality, IEEE Press (1998), 4--11.
[16]
}}Palmiter, S., Elkerton, J., An evaluation of animated demonstrations for learning computer-based tasks. In Proc. CHI 1991, ACM Press (1991), 257--263.
[17]
}}Ranjan, A., Birnholtz, J. P., Balakrishnan, R., An exploratory analysis of partner action and camera control in a video-mediated collaborative task. In Proc. CSCW 2006, ACM Press (2006), 403--412.
[18]
}}Swets, J.A., Feurzeig, W., Computer-aided instruction. Science, 150, 3696 (1965), 572--576.
[19]
}}Taketa, N., Hayashi, K., Kato, H., Noshida, S., Virtual pop-up book based on augmented reality. In Interacting in Information Environments, Springer, 2007, 475--484.
[20]
}}Tang, A., Owen, C., Biocca, F., Mou, W., Comparative effectiveness of augmented reality in object assembly. In Proc. CHI 2003, ACM Press (2003), 73--80.
[21]
}}Vogel, D. and Baudisch, P. 2007. Shift: a technique for operating pen-based interfaces using touch. In Proc. CHI 2007, ACM Press (2007), 657--666.
[22]
}}Vermunt, J.K. Log-linear Models for Event Histories. Thousand Oaks, California: Sage Publications, 1997.
[23]
}}Watson, G., Curran, R., Butterfield, J., Craig, C., The effect of using animated work instructions over text and static graphics when performing a small scale engineering assembly. In Proc. CE 2008, Springer (2008), 541--550.

Cited By

View all
  • (2019)Comparing Human Factors for Augmented Reality Supported Single-User and Collaborative Repair Operations of Industrial RobotsFrontiers in Robotics and AI10.3389/frobt.2019.000376Online publication date: 31-May-2019
  • (2019)"The Printer is Telling Me about Itself"Proceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322342(331-344)Online publication date: 18-Jun-2019
  • (2019)Opportunities for In-Home Augmented Reality GuidanceExtended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290607.3312933(1-6)Online publication date: 2-May-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
UbiComp '10: Proceedings of the 12th ACM international conference on Ubiquitous computing
September 2010
366 pages
ISBN:9781605588438
DOI:10.1145/1864349
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

  • University of Florida: University of Florida

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 September 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. augmented reality
  2. computer vision
  3. computer-assisted instruction
  4. everyday tasks
  5. micro-projection
  6. task guidance

Qualifiers

  • Research-article

Conference

Ubicomp '10
Ubicomp '10: The 2010 ACM Conference on Ubiquitous Computing
September 26 - 29, 2010
Copenhagen, Denmark

Acceptance Rates

UbiComp '10 Paper Acceptance Rate 39 of 202 submissions, 19%;
Overall Acceptance Rate 764 of 2,912 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)16
  • Downloads (Last 6 weeks)1
Reflects downloads up to 09 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2019)Comparing Human Factors for Augmented Reality Supported Single-User and Collaborative Repair Operations of Industrial RobotsFrontiers in Robotics and AI10.3389/frobt.2019.000376Online publication date: 31-May-2019
  • (2019)"The Printer is Telling Me about Itself"Proceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322342(331-344)Online publication date: 18-Jun-2019
  • (2019)Opportunities for In-Home Augmented Reality GuidanceExtended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290607.3312933(1-6)Online publication date: 2-May-2019
  • (2018)A Systematic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014Frontiers in Robotics and AI10.3389/frobt.2018.000375Online publication date: 17-Apr-2018
  • (2017)Understanding and supporting histopathology slide sortingBehaviour & Information Technology10.1080/0144929X.2016.124265236:5(447-458)Online publication date: 1-May-2017
  • (2016)Projecting Recorded Expert Hands at Real Size, at Real Speed, and onto Real Objects for Manual WorkCompanion Publication of the 21st International Conference on Intelligent User Interfaces10.1145/2876456.2879476(13-17)Online publication date: 7-Mar-2016
  • (2015)Smart MakerspaceProceedings of the 2015 International Conference on Interactive Tabletops & Surfaces10.1145/2817721.2817741(83-92)Online publication date: 15-Nov-2015
  • (2015)Visual Subliminal Cues for Spatial Augmented RealityProceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality Workshops10.1109/ISMARW.2015.11(4-11)Online publication date: 29-Sep-2015
  • (2014)Object-based touch manipulation for remote guidance of physical tasksProceedings of the 2nd ACM symposium on Spatial user interaction10.1145/2659766.2659768(113-122)Online publication date: 4-Oct-2014
  • (2014)Situated Micro-displays for Activity-Aware SystemsDistributed, Ambient, and Pervasive Interactions10.1007/978-3-319-07788-8_42(450-461)Online publication date: 2014
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media