Sensitivity to haptic-audio asynchrony

ABSTRACT

The natural role of sound in actions involving mechanical impact and vibration suggests the use of auditory display as an augmentation to virtual haptic interfaces. In order to budget available computational resources for sound simulation, the perceptually tolerable asynchrony between paired haptic-auditory sensations must be known. This paper describes a psychophysical study of detectable time delay between a voluntary hammer tap and its auditory consequence (a percussive sound of either 1, 50, or 200 ms duration). The results show Just Noticeable Differences (JNDs) for temporal asynchrony of 24 ms with insignificant response bias. The invariance of JND and response bias as a function of sound duration in this experiment indicates that observers cued on the initial attack of the auditory stimuli.

References

1. Craig, J. C., and Baihua, X. Temporal order and tactile patterns. Perception & Psychophysics, 74, 1990, 22--34.
2. Doel, van den, K., and Pai, D. K. The sounds of physical shape. Presence, 7(4), 1998, 382--395.
3. DiFranco, D. E., Beauregard, G. L., and Srinivasan, M. A. The effect of auditory cues on the haptic perception of stiffness in virtual environments. Proceedings, ASME Dyn. Syst. & Control. (Dallas, TX, 1997). Vol-DSC-61, 17--22.
4. Finney, D. J. Probit Analysis, 2nd Edition. Cambridge University Press, Cambridge, UK, 1962.
5. Fouad, H., Ballas, J. A., and Brock, D. An extensible toolkit for creating virtual sonic environments, Proceedings, International Conference on Auditory Displays, ICAD 2000 (Atlanta, GA, 2000).
6. Gescheider, G. A. Auditory and cutaneous temporal resolution of successive brief stimuli. J. Exp. Psych. 75(4), 1967, 570--572.
7. Hendrix, C. M., Cheng, P., and Durfee, W. K. Relative influence of sensory cues in a multi-modal virtual; environment. Proceedings, ASME Dyn. Syst. & Control. (Nashville, TN, 1999). Vol-DSC-67, 59--64.
8. Lederman, S. J., Klatzky, R. L., Morgan, T., and Hamilton, C. Integrated multimodal information about surface texture via a probe: relative contributions of haptic and touch-produced sound sources. Proceedings, Haptic Interfaces for Virtual Environment and Teleoperator Systems (Orlando, FL, 2002), 97--104.
9. Lederman, S. J., Martin, A. M., Tong, C., and Klatzky, R. L. Relative performance using haptic and/or touch-produced auditory cues in a remote absolute texture identification task. Proceedings, Haptic Interfaces for Virtual Environment and Teleoperator Systems (Los Angeles, CA, 2003), 151--158.
10. Levitin, D. J., MacLean, K., Mathews, M., Chu L, and Jensen, E. The perception of cross-modal simultaneity. Proceedings, Computing Anticipatory Systems (Liege, Belgium, 1999). AIP Conf. Proc. 517, 2000, 323--329.
11. Levitt, H. Transformed up-down methods in psychoacoustics. J. Acoustical Soc. of America, 49(2), 1970, 467--477.
12. Spence, C., and Driver, J. Cross-modal links in attention between audition, vision and touch: implications for interface design. Internat. J. Cognitive Ergonomics. 1(4), 1997, 351--373.
13. Van Doren, C. L., Gescheider, G. A., and Verillo, R. T. Vibrotactile temporal gap detection as a function of age. J. Acoustical Soc. of America, 87(5), 1990, 2201--2206.
14. Welch, R. B. Meaning, attention, and the unity assumption in the intersensory bias of spatial and temporal perceptions. In G. Aschersleben, T. Bachmann, and J. Musseler (Eds.), Cognitive Contributions to the Perception of Spatial and Temporal Events. Elsevier, Amsterdam, 1999, 371--387.
15. Welch, R. B, and Warren, D. H. Immediate perceptual response to intersensory discrepancy. Psych. Bulletin, 88, 1980, 638--667.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Haptic devices

    • Interaction techniques

      • Auditory feedback