skip to main content
10.1145/1647314.1647368acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
research-article

Mediated attention with multimodal augmented reality

Published: 02 November 2009 Publication History

Abstract

We present an Augmented Reality (AR) system to support collaborative tasks in a shared real-world interaction space by facilitating joint attention. The users are assisted by information about their interaction partner's field of view both visually and acoustically. In our study, the audiovisual improvements are compared with an AR system without these support mechanisms in terms of the participants' reaction times and error rates. The participants performed a simple object-choice task we call the "gaze game" to ensure controlled experimental conditions. Additionally, we asked the subjects to fill in a questionnaire to gain subjective feedback from them. We were able to show an improvement for both dependent variables as well as positive feedback for the visual augmentation in the questionnaire.

References

[1]
K. Arthur. Effects of field of view on performance with head-mounted displays. PhD thesis, University of North Carolina, 2000.
[2]
A. Dierker, T. Bovermann, M. Hanheide, T. Hermann, and G. Sagerer. A multimodal augmented reality system for alignment research. In Proceedings of the 13th International Conference on Human-Computer Interaction, pages 422--426, San Diego, USA, July 2009.
[3]
S. Feiner, B. Macintyre, and D. Seligmann. Knowledge-based augmented reality. Commun. ACM, 36(7):53--62, 1993.
[4]
T. Hermann. Taxonomy and definitions for sonification and auditory display. In B. Katz, editor, Proc. 14th Int. Conf. Auditory Display (ICAD 2008), pages 1--8, Paris, France, June 2008.
[5]
D. Kalkofen, E. Mendez, and D. Schmalstieg. Interactive focus and context visualization for augmented reality. Mixed and Augmented Reality, IEEE/ACM International Symposium on, 0:1--10, 2007.
[6]
H. Kato and M. Billinghurst. Marker tracking and hmd calibration for a video-based augmented reality conferencing system. Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality, 99:85--94, 1999.
[7]
H. Koesling. Visual Perception of Location, Orientation and Length: An Eye-Movement Approach. PhD thesis, Bielefeld University, 2003.
[8]
E. Mendez, D. Kalkofen, and D. Schmalstieg. Interactive context-driven visualization tools for augmented reality. In Proc. IEEE/ACM International Symposium on Mixed and Augmented Reality ISMAR 2006, pages 209--218, 2006.
[9]
C. Mertes. Multimodal augmented reality to enhance human communication. Master's thesis, Bielefeld University, Aug. 2008.
[10]
C. Mertes, A. Dierker, T. Hermann, M. Hanheide, and G. Sagerer. Enhancing human cooperation with multimodal augmented reality. In Proceedings of the 13th International Conference on Human-Computer Interaction, pages 447--451, San Diego, USA, July 2009.
[11]
M. Posner and Y. Cohen. Components of visual orienting. Attention and performance X, pages 531--556, 1984.
[12]
G. Reitmayr and D. Schmalstieg. Collaborative augmented reality for outdoor navigation and information browsing. In Proc. Symposium Location Based Services and TeleCartography, 2004.
[13]
A. Tang, C. Owen, F. Biocca, and W. Mou. Comparative effectiveness of augmented reality in object assembly. In CHI '03: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 73--80, New York, NY, USA, 2003. ACM.
[14]
C. Wisneski, H. Ishii, A. Dahley, M. Gobert, S. Brave, B. Ullmer, and P. Yarin. Ambient displays: Turning architectural space into an interface between people and digital information. In N. Streitz, S. Konomi, and H. Burkhardt, editors, Proc. Int. Workshop on Cooperative Buildings, pages 22--32, Darmstadt, Germany, Feb. 1998.

Cited By

View all
  • (2024)Workplace Aspects of Knowledge and Expertise Sharing Practices Supported by Augmented Reality Systems: Findings from a Design Case StudyComputer Supported Cooperative Work (CSCW)10.1007/s10606-024-09508-8Online publication date: 17-Dec-2024
  • (2021)Literature Review on Co-Located Collaboration Modeling Using Multimodal Learning Analytics—Can We Go the Whole Nine Yards?IEEE Transactions on Learning Technologies10.1109/TLT.2021.309776614:3(367-385)Online publication date: 1-Jun-2021
  • (2019)How the Multimodal Media in Augmented Reality Affects Museum Learning Experience2019 12th Asia Pacific Workshop on Mixed and Augmented Reality (APMAR)10.1109/APMAR.2019.8709286(1-4)Online publication date: Mar-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ICMI-MLMI '09: Proceedings of the 2009 international conference on Multimodal interfaces
November 2009
374 pages
ISBN:9781605587721
DOI:10.1145/1647314
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. artificial communication channels
  2. augmented reality
  3. collaboration
  4. cscw
  5. field of view
  6. joint attention
  7. mediated attention
  8. multimodal

Qualifiers

  • Research-article

Conference

ICMI-MLMI '09
Sponsor:

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)18
  • Downloads (Last 6 weeks)0
Reflects downloads up to 30 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Workplace Aspects of Knowledge and Expertise Sharing Practices Supported by Augmented Reality Systems: Findings from a Design Case StudyComputer Supported Cooperative Work (CSCW)10.1007/s10606-024-09508-8Online publication date: 17-Dec-2024
  • (2021)Literature Review on Co-Located Collaboration Modeling Using Multimodal Learning Analytics—Can We Go the Whole Nine Yards?IEEE Transactions on Learning Technologies10.1109/TLT.2021.309776614:3(367-385)Online publication date: 1-Jun-2021
  • (2019)How the Multimodal Media in Augmented Reality Affects Museum Learning Experience2019 12th Asia Pacific Workshop on Mixed and Augmented Reality (APMAR)10.1109/APMAR.2019.8709286(1-4)Online publication date: Mar-2019
  • (2018)A Systematic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014Frontiers in Robotics and AI10.3389/frobt.2018.000375Online publication date: 17-Apr-2018
  • (2017)Multimodal fusionInternational Journal of Computational Vision and Robotics10.1504/IJCVR.2017.0834527:3(240-254)Online publication date: 1-Jan-2017
  • (2015)Vision-Based Technique and Issues for Multimodal Interaction in Augmented RealityProceedings of the 8th International Symposium on Visual Information Communication and Interaction10.1145/2801040.2801058(75-82)Online publication date: 24-Aug-2015
  • (2015)Designing to Split Attention in a Mixed Reality GameProceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play10.1145/2793107.2810289(691-696)Online publication date: 5-Oct-2015
  • (2015)Multimodal Fusion: Gesture and Speech Input in Augmented Reality EnvironmentComputational Intelligence in Information Systems10.1007/978-3-319-13153-5_24(245-254)Online publication date: 2015
  • (2013)Sonification for supporting joint attention in dyadic augmented reality-based cooperationProceedings of the 8th Audio Mostly Conference10.1145/2544114.2597651(1-6)Online publication date: 18-Sep-2013
  • (2013)Evaluation of attention-guiding video visualizationProceedings of the 15th Eurographics Conference on Visualization10.1111/cgf.12092(51-60)Online publication date: 17-Jun-2013
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media