How to not hit a virtual wall: aural spatial awareness for collision avoidance in virtual environments

ABSTRACT

Compared to graphics, sound is still an underused modality for conveying information and providing users with more than just general ambience or targeted sound effects. Collision notification is one case of direct aural feedback: The moment a user hits a wall, they hear an appropriate sound e.g. a thump. We tried to go further by using contextual spatial sound to provide collision avoidance feedback, which plays continuously in the background, but, unlike ambient soundscapes, reacts accurately and in real-time to upcoming collision hazards. In a first experimental design, we provided directional spatial sound feedback for collision avoidance in a prototypical labyrinth environment and examined the performance and reactions of a group of test subjects, who navigated through the labyrinth. Our initial design already received positive reactions from the subjects and analysis of the performance data shows first results indicating the viability of this kind of spatial sound feedback.

References

1. C. Afonso. Sound-enhanced spatial awareness for navigation in virtual environments. Diploma thesis, University of Hamburg, Department of Informatics, im.ve Group, 2011.
2. D. Aguerrevere, M. Choudhury, and A. Barreto. Portable 3d sound/sonar navigation system for blind individuals. In 2nd LACCEI, Miami, FL, 2004.
3. K. J. Blom and S. Beckhaus. Virtual collision notification. In Proceedings of the 2010 IEEE Symposium on 3D User Interfaces (3DUI), pages 35--38, Waltham, MA, USA, 2010. TechNote.
4. T. Garner, M. Grimshaw, and D. A. Nabi. A preliminary experiment to assess the fear value of preselected sound parameters in a survival horror game. In Proceedings of the 5th Audio Mostly Conference: A Conference on Interaction with Sound, AM '10, pages 10:1--10:9, New York, NY, USA, 2010.
5. A. Gonot, S. Natkin, M. Emerit, and N. Chateau. An experiment in the perception of space through sound in virtual world and games. In Proceedings of CGAMES, 2006.
6. N. Hess, J. D. Wischweh, K. Albrecht, K. J. Blom, and S. Beckhaus. ACTIF: An interactor centric interaction framework. In Proceedings of the ACM conference on Virtual Reality Software and Technology (VRST) 2008, pages 39--42. ACM Press, 2008.
7. S. Holland, D. R. Morse, and H. Gedenryd. AudioGPS: Spatial audio navigation with a minimal attention interface. Personal and Ubiquitous Computing, 6(4):253--259, September 2002.
8. T. Ifukube, T. Sasaki, and C. Peng. A blind mobility aid modeled after echolocation of bats. In IEEE Transactions on Biomedical Engineering, volume 38, pages 461--465, May 1991.
9. P. Meijer. An experimental system for auditory image representations. In IEEE Transactions on Biomedical Engineering, volume 39, pages 112--121, 1992.
10. S. Shoval, J. Borenstein, and Y. Koren. Mobile robot obstacle avoidance in a computerized travel aid for the blind. In IEEE Robot. Autom. Conf. 1994, pages 2023--2029, San Diego, CA, May 1994.
11. M. Supa, M. Cotzin, and K. Dallenbach. "Facial vision": The perception of obstacles by the blind. The American Journal of Psychology, 57(2):133--183, 1944.
12. T. Tullis and B. Albert. Measuring the User Experience. Morgan Kaufman, Burlington, MA, 2008.
13. V. Twersky. On the physical basis of the perception of obstacles by the blind. The American Journal of Psychology, 64(3):409--416, 1951.
14. B. N. Walker and J. Lindsay. Navigation performance with a virtual auditory display: Effects of beacon sound, capture radius, and practise. Human Factors, 48:265--278, 2006.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction techniques

      • Auditory feedback