Investigating the performance of path-searching tasks in depth on multiview displays

Abstract

Multiview auto-stereoscopic displays support both stereopsis and head motion parallax depth cues and could be superior for certain tasks. Previous work suggests that a high viewpoint density (100 views/10cm at the eye) is required to convincingly support motion parallax. However, it remains unclear how viewpoint density affects task performance, and this factor is critical in determining display and system design requirements. Therefore, we present a simulated multiview display apparatus to undertake experiments using a path-searching task in which we control two independent variables: the stereoscopic depth and the viewpoint density. In the first experiment, we varied both cues and found that even small amounts of stereo depth (2cm) reliably improved task accuracy and reduced latency, whereas there was no evidence of dependence on viewpoint density. In the second experiment, we switched off the stereoscopic cue and varied viewpoint density alone. We found that for these monoscopic images increasing viewpoint density resulted in some reduction in response latency (up to eight views/10cm) but had no effect on accuracy. We conclude for cases where occlusion is not an overriding factor that low viewpoint densities may be sufficient to enable effective path-searching task performance.

References

1. Bradshaw, M. F., Parton, A. D., and Glennerster, A. 2000. The task-dependent use of binocular disparity and motion parallax information. Vision Res. 40, 27, 3725--3734.
2. Braunstein, M. L. 1968. Motion and texture as sources of slant information. J. Exp. Psychol. 78, 2, 247--253.
3. Bruno, N. and Cutting, J. E. 1988. Minimodularity and the perception of layout. J. Exp. Psych. Gen. 117, 2, 161--170.
4. Dodgson, N. A. 2004. Variation and extrema of human interpupillary distance. In Proceedings of the Conference on Stereoscopic Displays and Virtual Reality Systems XI. SPIE, Bellingham, WA, 36--46.
5. Dosher, B. A., Sperling, G., and Wurst, S. 1986. Trade-offs between stereoscopic and proximity luminance covariance as determinants of perceived 3D structure. Vision Res. 26, 6, 973--990.
6. Gilson, S. J., Fitzgibbon, A. W., and Glennerster, A. 2006. Quantitative analysis of accuracy of an inertial/acoustic 3D of tracking system in motion. J. Neurosci. Methods. 154, 1-2, 175--82.
7. Glennerster, A., Rodgers, B. J., and Bradshaw, M. F. 1996. Stereoscopic depth constancy depends on the subject's task. Vision Res. 36, 21, 3441--3456.
8. Hodges, L. F. and Mcallister, D. F. 1993. Stereo Computer Graphics and Other True 3D Technologies. Princeton University Press, Princeton, NJ, 71--89.
9. Holliman, N. S. 2006. Handbook of Optoelectronics, vol. 2. Taylor & Francis, Boca Raton, FL.
10. Hosokawa, K., Ohtsuka, S., and Sato, T. 2005. Depth perception from intermittent motion parallax stimuli. J. Vision 5, 8, 729--729.
11. Hsu, J., Pizlo, Z., Chelberg, D., Babbs, C., and Delp, E. 1996. Issues in the design of studies to test the effectiveness of stereo imaging. IEEE Trans. Syst. Man Cybern. Part A Syst. Humans 26, 6, 810--819.
12. Johnston, E. B. 1991. Systematic distortions of shape from stereoscopic. Vision Res. 31, 7/8, 1351--1360.
13. Johnston, E. B., Cumming, B. G., and Landy, M. S. 1994. Integration of stereoscopic and motion shape cues. Vision Res. 34, 17, 2259--2275.
14. Jones, G. R., Lee, D., Holliman, N. S., and Ezra, D. 2001. Controlling perceived depth in stereoscopic images. In Proceedings of the Conference on Stereoscopic Displays and Virtual Reality Systems VIII. SPIE, Bellingham, WA, 42--53.
15. Koenderink, J. J. and Van Doorn, A. J. 1991. Affine structure from motion. J. Opt. Soc. Am. A. 8, 2, 377--385.
16. Lambooij, M. T. M., Ijsselsteijn, W. A., and Heynderickx, I. 2007. Visual discomfort in stereoscopic displays: A review. In Proceedings of the SPIE Conference on Stereoscopic Displays and Virtual Reality Systems XIV. SPIE, Bellingham, WA.
17. Landy, M. S. and Kojima, H. 2001. Ideal cue combination for localizing texture-defined edges. J. Opt. Soc. Am. A. Opt. Image Sci. Vision 18, 9, 2307--2320.
18. Landy, M. S., Maloney, L. T., Johnston, E. B., and Young, M. 1995. Measurement and modeling of depth cue combination: in defense of weak fusion. Vision Res. 35, 3, 389--412.
19. Mcallister, D. F. 1993a. Stereo Computer Graphics and Other True 3D Technologies. Princeton University Press, Princeton, NJ.
20. Mcallister, D. F. 1993b. Stereo Computer Graphics and Other True 3D Technologies. Princeton University Press, Princeton, NJ, 1--10.
21. Merritt, J. O. and Cole, R. E. 1992. Interaction between binocular and monocular depth cues in teleoperation task performance. SID 92 Digest.
22. Mitsuhashi, T. 1996. Evaluation of stereoscopic picture quality with ccf. Ergonomics 39, 11, 1244--1356.
23. Mon-Williams, M., Wann, J. P., and Rushton, S. 1993. Binocular vision in a virtual world: Visual deficits following the wearing of a head-mounted display. Ophthalmic. Physiol. Opt. 13, 4, 387--391.
24. Nakanuma, H., Kamei, H., and Takaki, Y. 2005. Natural 3D display with 128 directional images used for human-engineering evaluation. In Proceedings of the Conference on Stereoscopic Displays and Virtual Reality Systems XII. SPIE, Bellingham, WA, 28--35.
25. Ogle, K. N. and Prangen, A. 1953. Observations on vertical divergences and hyperphorias. Arch Ophthal. 49, 313--334.
26. Ono, M. E., Rivest, J., and Ono, H. 1986. Depth perception as a function of motion parallax and absolute distance information. J. Exp. Psych. Human Percept. Perform. 12, 331--337.
27. Oruc, I., Maloney, L. T., and Landy, M. S. 2003. Weighted linear cue combination with possibly correlated error. Vision Res. 43, 2451--2468.
28. Pastoor, S. and Schenke, K. 1989. Subjective assessments of the resolution of viewing directions in a multi-viewpoint 3D TV system. Proceedings of SID. 30, 3, 217--222.
29. Peli, E. 1996. Health and safety issues with head-mounted displays(hmd). In Proceedings of the International Display Workshop. Society for Information Display, Campbell, CA, 493--496.
30. Relke, I., Klippstein, M., and Riemann, B. 2004. Assessment and improvement of the stereo-image visualization on X3D technologies 3D displays. In Proceedings of the Conference on Stereoscopic Displays and Virtual Reality Systems XII. SPIE, Bellingham, WA, 204--211.
31. Rogers, B. J. and Graham, M. E. 1979. Motion parallax as an independent cue for depth perception. Perception 8, 125--134.
32. Runde, D. 2000. How to realize a natural image reproduction using stereoscopic displays with motion parallax. IEEE Trans. Circuits Syst. Video Techn. 10, 3, 376--386.
33. Sharma, K. and Abdul-Rahim, A. S. 1992. Vertical fusion amplitude in normal adults. Am J Ophthal. 114, 636--637.
34. Siegel, M., Tobinaga, Y., and Akiya, T. 1999. Kinder gentler stereo. In Proceedings of the Conference on Stereoscopic Displays and Virtual Reality Systems VI. SPIE, Bellingham, WA, 18--27.
35. Sollenberger, R. L. and Milgram, P. 1993. Effects of stereoscopic and rotational displays in a 3D path-tracing task. Human Factors. 35, 3, 483--499.
36. Speranza, F., Tam, W. J., Martin, T., and Stelmach, L. 2005. Perceived smoothness of viewpoint transition in multi-viewpoint stereoscopic displays. In Proceedings of the Conference on Stereoscopic Displays and Virtual Reality Systems XII. SPIE, Bellingham, WA, 72--82.
37. Takeda, T., Hashimoto, K., Hiruma, N., and Fukui, Y. 1999. Characteristics of accommodation toward apparent depth. Vision Res. 39, 2087--2097.
38. Tittle, J. S. and Braunstein, M. L. 1993. Recovery of 3D shape from binocular disparity and structure from motion. Percept. Psychophys. 54, 2, 157--169.
39. Valyus, N. A. 1966. Stereoscopy. Focal Press, London.
40. Ware, C. and Franck, G. 1996. Evaluating stereo and motion cues for visualizing information nets in three dimensions. ACM Trans. Graph. 15, 2, 121--140.
41. Ware, C. AND Mitchell, P. 2005. Reevaluating stereo and motion cues for visualizing graphs in three dimensions. In Proceedings of the 2nd Symposium on Applied Perception in Graphics and Visualization. ACM, New York, 51--58.
42. Wartell, Z. 2001. Stereoscopic head-tracked displays: analysis and development of display algorithms. Ph.D. thesis, Georgia Institute of Technology.
43. Williams, S. P. and Parrish, R. V. 1990. New computational control techniques and increased understanding for stereo 3D displays. In Proceedings of the Conference on Stereoscopic Displays and Virtual Reality Systems XII. SPIE, Bellingham, WA, 73--82.
44. Yeh, Y. and Silverstien, L. D. 1990. Limits of fusion and depth judgement in stereoscopic color displays. Human Factors 32, 1, 45--60.
45. Young, M. J., Landy, M. S., and Maloney, L. T. 1993. A perturbation analysis of depth perception from combinations of texture and motion cues. Vision Res. 33, 18, 2685--2696.

Index Terms

• Computing methodologies

  • Computer graphics

    • Graphics systems and interfaces

      • Virtual reality

• Human-centered computing

  • Accessibility

  • Human computer interaction (HCI)

    • Empirical studies in HCI

    • Interaction paradigms

      • Mixed / augmented reality

      • Virtual reality