skip to main content
article

Using wavelets to synthesize stochastic-based sounds for immersive virtual environments

Published: 01 October 2005 Publication History

Abstract

Stochastic, or nonpitched, sounds fill our real-world environment. Humans almost continuously hear stochastic sounds, such as wind, rain, motor sounds, and different types of impact sounds. Because of their prevalence in real-world environments, it is important to include these types of sounds for realistic virtual environment simulations. This paper describes a synthesis approach that uses wavelets for modeling stochastic-based sounds. Parameterizations of the wavelet models yield a variety of related sounds from a small set of models. The result is dynamic sound models that can change according to changes in the virtual environment. This paper contains a description of the sound synthesis process, several developed models, and the on-going perceptual experiments for validating the sound synthesis veracity. The developed models and results demonstrate proof of the concept and illustrate the potential of this approach.

References

[1]
Ballas, J. 1993. Common factors in the identification of an assortment of brief everyday sounds. Journal of Experimental Psychology: Human Perception and Performance 19, 2, 250--267.
[2]
Cohen, A. and Ryan, R. D. 1995. Wavelets and Multiscale Signal Processing. Chapman & Hall, London.
[3]
Daubechies, I. 1992. Ten Lectures on Wavelets. SIAM, Philadelphia.
[4]
Gaver, W. 1994. Using and creating auditory icons. In Auditory Display: Sonification, Audification, and Auditory Interfaces, G. Kramer, Ed. Vol XVIII. Santa Fe Institute Studies in the Science of Complexity, Addison-Wesley, Reading, MA. 417--446.
[5]
Goldsmith T. E., Johnson, P. J., and Acton, W. H. 1991. Assessing structural knowledge. Journal of Educational Psychology 83, 1, 88--96.
[6]
Miner, N. 1994. Using voice input and audio feedback to enhance the reality of a virtual experience. In Proceedings of the 1994 IMAGE Conference. Tucson, AZ, June 1994.
[7]
Miner, N. 1998. A Wavelet approach to synthesizing perceptually convincing sounds for virtual environments and multi-media. Ph.D. dissertation. University of New Mexico.
[8]
Miner, N. E. and Caudell, T. P. 2002. A wavelet synthesis technique for creating realistic virtual environment sounds. Presence: Teleoperators and Virtual Environments 11, 5, 493--507.
[9]
Mynatt, E. D. 1994. Designing with auditory icons. In Proceedings of the Second International Conference on Auditory Display (ICAD). Nov. 109--119.
[10]
Ogden, R. 1997. Essential Wavelets for Statistical Applications & Data Analysis. Birkhauser.
[11]
Serra, X. 1989. A system for sound analysis/transformation/synthesis based on a deterministic plus stochastic decomposition. Ph.D. Dissertation, Report No. STAN-M-58. CCRMA and Department of Music, Stanford, University, October.
[12]
Shepard, R. N. 1980. Multidimensional scaling, tree-fitting, and clustering. Science 210, 10/24/80, 390--398.
[13]
Smith, J. O. 1992. Physical modeling using digital waveguides. Computer Music Journal, MIT Press 16, 4.
[14]
van den Doel, K. and Pai, D. K. 1997. Synthesis of shape dependent sounds with physical modeling. Proceedings of the International Conference on Auditory Displays. Santa Clara, CA.

Cited By

View all
  • (2024)Geräuschanalyse und TextursyntheseHandbuch der Audiotechnik10.1007/978-3-662-60357-4_11-1(1-17)Online publication date: 11-Jul-2024
  • (2018)Perceptual Evaluation of Synthesized Sound EffectsACM Transactions on Applied Perception10.1145/316528715:2(1-19)Online publication date: 10-Apr-2018
  • (2012)Temporal and amplitude aspects in sonically simulating walking over bumps, holes and flat surfacesAcoustical Science and Technology10.1250/ast.33.29133:5(291-300)Online publication date: 2012
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Applied Perception
ACM Transactions on Applied Perception  Volume 2, Issue 4
October 2005
191 pages
ISSN:1544-3558
EISSN:1544-3965
DOI:10.1145/1101530
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2005
Published in TAP Volume 2, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Sound synthesis
  2. audio perception
  3. immersive environments
  4. virtual reality
  5. wavelets

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)0
Reflects downloads up to 30 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Geräuschanalyse und TextursyntheseHandbuch der Audiotechnik10.1007/978-3-662-60357-4_11-1(1-17)Online publication date: 11-Jul-2024
  • (2018)Perceptual Evaluation of Synthesized Sound EffectsACM Transactions on Applied Perception10.1145/316528715:2(1-19)Online publication date: 10-Apr-2018
  • (2012)Temporal and amplitude aspects in sonically simulating walking over bumps, holes and flat surfacesAcoustical Science and Technology10.1250/ast.33.29133:5(291-300)Online publication date: 2012
  • (2011)An Investigation on Temporal Aspects in the Audio-Haptic Simulation of FootstepsMultidisciplinary Aspects of Time and Time Perception10.1007/978-3-642-21478-3_9(101-115)Online publication date: 2011
  • (2010)An Investigation on Temporal Aspects in the Audio-Haptic Simulation of FootstepsRevised Selected Papers of the COST TD0904 International Workshop on Multidisciplinary Aspects of Time and Time Perception - Volume 678910.5555/3089822.3089831(101-115)Online publication date: 7-Oct-2010
  • (2010)Influence of auditory and visual feedback for perceiving walking over bumps and holes in desktop VRProceedings of the 17th ACM Symposium on Virtual Reality Software and Technology10.1145/1889863.1889893(139-142)Online publication date: 22-Nov-2010
  • (2009)Harmonic fluidsACM SIGGRAPH 2009 papers10.1145/1576246.1531343(1-12)Online publication date: 27-Jul-2009
  • (2009)Harmonic fluidsACM Transactions on Graphics10.1145/1531326.153134328:3(1-12)Online publication date: 27-Jul-2009

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media