Article

Real-time auditory-visual distance rendering for a virtual reaching task

Authors:

Federico Avanzini,

Thomas A. StoffregenAuthors Info & Claims

VRST '07: Proceedings of the 2007 ACM symposium on Virtual reality software and technology

Pages 179 - 182

https://doi.org/10.1145/1315184.1315217

Published: 05 November 2007 Publication History

Abstract

This paper reports on a study on the perception and rendering of distance in multimodal virtual environments. A model for binaural sound synthesis is discussed, and its integration in a real-time system with motion tracking and visual rendering is presented. Results from a validation experiment show that the model effectively simulates relevant auditory cues for distance perception in dynamic conditions. The model is then used in a subsequent experiment on the perception of egocentric distance. The design and preliminary result from this experiment are discussed.

References

[1]

Begault, D. 1991. Preferred sound intensity increase for sensation of half distance. Perc. and Motor Skills 72, 1019--1029.

[2]

Brown, C. P., and Duda, R. O. 1998. A structural model for binaural sound synthesis. IEEE Trans. Speech Audio Process. 6, 5, 476--488.

[3]

Brungart, D. S. 2002. Near-field virtual audio displays. Presence: Teleoperators and Virtual Environment 11, 1, 93--106.

Digital Library

[4]

Duda, R. O., and Martens, W. L. 1998. Range dependence of the response of a spherical head model. J. Acoust. Soc. Am. 104, 5, 3048--3058.

[5]

Gardner, M. B. 1969. Distance estimation of 0° or apparent 0°-oriented speech signals in anechoic space. J. Acoust. Soc. Am. 45, 1, 47--53.

[6]

Mantel, B., Bardy, B. G., and Stoffregen, T. A. 2005. Intermodal specification of egocentric distance in a target reaching task. In Studies in Perception and Action VIII, H. Heft and K. L. Marsh, Eds. Erlbaum, Mahwah, 173--176.

[7]

Mershon, D. H., and Bowers, J. N. 1979. Absolute and relative cues for the auditory perception of egocentric distance. Perception 8, 3, 311--322.

[8]

Perrett, S., and Noble, W. 1997. The effect of head rotations on vertical plane sound localization. J. Acoust. Soc. Am. 102, 4, 2325--2332.

[9]

Speigle, J. M., and Loomis, J. M. 1993. Auditory distance perception by translating observers. In Proc. IEEE Symposium on Research Frontiers in Virtual Reality, 92--99.

[10]

Stoffregen, T. A., and Bardy, B. G. 2001. On specification and the senses. Behavioral and Brain Sciences 24, 2, 195--213.

[11]

Thurlow, W. R., and Runge, P. S. 1967. Effect of induced head movements on localization of direction of sounds. J. Acoust. Soc. Am. 42, 2, 480--488.

[12]

Wallach, H. 1940. The role of head movement and vestibular and visual cues in sound localization. J. Experimental Psychology 27, 339--368.

[13]

Wightman, F. L., and Kistler, D. J. 1999. Resolution of front-back ambiguity in spatial hearing by listener and source movement. J. Acoust. Soc. Am. 105, 5, 2841--2853.

[14]

Zahorik, P., Brungart, D. S., and Bronkhorst, A. 2005. Auditory distance perception in humans: a summary of past and present research. Acta Acustica -- Acustica 91, 3, 409--420.

[15]

Zahorik, P. 2001. Estimating sound source distance with and without vision. Optometry and Vision Science 78, 5, 270--275.

Cited By

Delgado Rodriguez SRivu RMäkelä VAlt FWard JMcGill MMarky K(2023)Challenges in Virtual Reality Studies: Ethics and Internal and External ValidityProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582716(105-111)Online publication date: 12-Mar-2023
https://dl.acm.org/doi/10.1145/3582700.3582716
Zwinderman MZavialova TTetteroo DLehouck PBylund MJuhlin OFernaeus Y(2011)Oh music, where art thou?Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services10.1145/2037373.2037456(533-538)Online publication date: 30-Aug-2011
https://dl.acm.org/doi/10.1145/2037373.2037456

Index Terms

Real-time auditory-visual distance rendering for a virtual reaching task
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality
    2. Interaction techniques
      1. Auditory feedback

Recommendations

Perceived Egocentric Distances in Real, Image-Based, and Traditional Virtual Environments
VR '02: Proceedings of the IEEE Virtual Reality Conference 2002

In virtual environments, perceived egocentric distances are consistently underestimated when compared to the same distance judgments in the real world. The research presented in this paper explores two possible causes for the compressed distance ...
The Role of 3-D Sound in Human Reaction and Performance in Augmented Reality Environments

Three-dimensional sound's effectiveness in virtual reality (VR) environments has been widely studied. However, due to the big differences between VR and augmented reality (AR) systems in registration, calibration, perceptual difference of immersiveness, ...
The sense of presence within auditory virtual environments

Two studies were performed to investigate the sense of presence within stereoscopic virtual environments as a function of the addition or absence of auditory cues. The first study examined the presence or absence of spatialized sound, while the second ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VRST '07: Proceedings of the 2007 ACM symposium on Virtual reality software and technology

November 2007

259 pages

ISBN:9781595938633

DOI:10.1145/1315184

Conference Chairs:
Aditi Majumder
UC Irvine
,
Larry Hodges
UNC - Charlotte
,
Daniel Cohen-Or
Tel Aviv University
,
Editor:
Stephen N. Spencer
University of Washington

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 November 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

VRST07

Sponsor:

VRST07: The ACM Symposium on Virtual Reality Software and Technology

November 5 - 7, 2007

California, Newport Beach

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
252
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Delgado Rodriguez SRivu RMäkelä VAlt FWard JMcGill MMarky K(2023)Challenges in Virtual Reality Studies: Ethics and Internal and External ValidityProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582716(105-111)Online publication date: 12-Mar-2023
https://dl.acm.org/doi/10.1145/3582700.3582716
Zwinderman MZavialova TTetteroo DLehouck PBylund MJuhlin OFernaeus Y(2011)Oh music, where art thou?Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services10.1145/2037373.2037456(533-538)Online publication date: 30-Aug-2011
https://dl.acm.org/doi/10.1145/2037373.2037456

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten