Improving visual quality of view transitions in automultiscopic displays

Abstract

Automultiscopic screens present different images depending on the viewing direction. This enables glasses-free 3D and provides motion parallax effect. However, due to the limited angular resolution of such displays, they suffer from hot-spotting, i. e., image quality is highly affected by the viewing position. In this paper, we analyze light fields produced by lenticular and parallax-barrier displays, and show that, unlike in real world, the light fields produced by such screens have a repetitive structure. This induces visual artifacts in the form of view discontinuities, depth reversals, and excessive disparities when viewing position is not optimal. Although the problem has been always considered as inherent to the technology, we demonstrate that light fields reproduced on automultiscopic displays have enough degrees of freedom to improve the visual quality. We propose a new technique that modifies light fields using global and local shears followed by stitching to improve their continuity when displayed on a screen. We show that this enhances visual quality significantly, which is demonstrated in a series of user experiments with an automultiscopic display as well as lenticular prints.

References

1. Agarwala, A., Zheng, K. C., Pal, C., Agrawala, M., Cohen, M., Curless, B., Salesin, D., and Szeliski, R. 2005. Panoramic video textures. ACM Trans. Graph. 24, 3, 821--827.
2. Agarwala, A. 2007. Efficient gradient-domain compositing using quadtrees. ACM Trans. Graph. 26, 3, 94.
3. Birklbauer, C., and Bimber, O. 2012. Light-field retargeting. Computer Graphics Forum 31, 2pt1, 295--303.
4. Brookes, A., and Stevens, K. A. 1989. The analogy between stereo depth and brightness. Perception 18, 5, 601--614.
5. Chen, B., Ofek, E., Shum, H.-Y., and Levoy, M. 2005. Interactive deformation of light fields. In Proceedings of the 2005 symposium on Interactive 3D graphics and games, ACM, 139--146.
6. Didyk, P., Ritschel, T., Eisemann, E., Myszkowski, K., Seidel, H.-P., and Matusik, W. 2012. A luminance-contrast-aware disparity model and applications. ACM Trans. Graph. 31, 6, 184.
7. Didyk, P., Sitthi-Amorn, P., Freeman, W., Durand, F., and Matusik, W. 2013. Joint view expansion and filtering for automultiscopic 3D displays. ACM Trans. Graph. 32, 6, 221:1--221:8.
8. Eisemann, M., Gohlke, D., and Magnor, M. 2011. Edge-constrained image compositing. In Proceedings of Graphics Interface 2011, Canadian Human-Computer Communications Society, 191--198.
9. Filippini, H. R., and Banks, M. S. 2009. Limits of stereopsis explained by local cross-correlation. Journal of Vision 9, 8--8.
10. Hirsch, M., Wetzstein, G., and Raskar, R. 2014. A compressive light field projection system. ACM Trans. Graph. 33, 4, 1--12. to appear.
11. Horn, D. R., and Chen, B. 2007. Lightshop: interactive light field manipulation and rendering. In Proceedings of the 2007 symposium on Interactive 3D graphics and games, ACM, 121--128.
12. Isaksen, A., McMillan, L., and Gortler, S. J. 2000. Dynamically reparameterized light fields. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley Publishing Co., 297--306.
13. Ives, F. E., 1903. Parallax stereogram and process of making same. U.S. Patent 725,567.
14. Jia, J., and Tang, C.-K. 2008. Image stitching using structure deformation. Pattern Analysis and Machine Intelligence, IEEE Transactions on 30, 4, 617--631.
15. Jia, J., Sun, J., Tang, C.-K., and Shum, H.-Y. 2006. Drag-and-drop pasting. ACM Trans. Graph. 25, 3, 631--637.
16. Kim, C., Hornung, A., Heinzle, S., Matusik, W., and Gross, M. 2011. Multi-perspective stereoscopy from light fields. ACM Trans. Graph. 30, 6, 190.
17. Kim, C., Zimmer, H., Pritch, Y., Sorkine-Hornung, A., and Gross, M. 2013. Scene reconstruction from high spatio-angular resolution light fields. ACM Trans. Graph..
18. Konrad, J., and Agniel, P. 2006. Subsampling models and anti-alias filters for 3-D automultiscopic displays. Image Processing, IEEE Transactions on 15, 1, 128--140.
19. Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: image and video synthesis using graph cuts. ACM Trans. Graph. 22, 3, 277--286.
20. Levin, A., Zomet, A., Peleg, S., and Weiss, Y. 2004. Seamless image stitching in the gradient domain. In Computer Vision-ECCV 2004. Springer, 377--389.
21. Levoy, M., and Hanrahan, P. 1996. Light field rendering. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, ACM, 31--42.
22. Lippmann, G. 1908. Épreuves réversibles donnant la sensation du relief. Journal of Physics 7, 4, 821--825.
23. Mahajan, D., Huang, F.-C., Matusik, W., Ramamoorthi, R., and Belhumeur, P. 2009. Moving gradients: a path-based method for plausible image interpolation. ACM Trans. Graph. 28, 3, 42.
24. Masia, B., Wetzstein, G., Aliaga, C., Raskar, R., and Gutierrez, D. 2013. Display adaptive 3D content remapping. Computers & Graphics 37, 8, 983--996.
25. Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Trans. Graph. 22, 3, 313--318.
26. Peterka, T., Kooima, R. L., Sandin, D. J., Johnson, A. E., Leigh, J., and Defanti, T. A. 2008. Advances in the Dynallax Solid-State Dynamic Parallax Barrier Autostereoscopic Visualization Display System. IEEE Transactions on Visualization and Computer Graphics 14, 487--499.
27. Rubinstein, M., Shamir, A., and Avidan, S. 2008. Improved seam carving for video retargeting. ACM Trans. Graph. 27, 3, 16:1--16:9.
28. Schödl, A., Szeliski, R., Salesin, D. H., and Essa, I. 2000. Video textures. In Annual Conference on Computer Graphics, SIGGRAPH '00, 489--498.
29. Shibata, T., Kim, J., Hoffman, D., and Banks, M. 2011. The zone of comfort: Predicting visual discomfort with stereo displays. Journal of Vision 11, 8, 11:1--11:29.
30. Stewart, J., Yu, J., Gortler, S. J., and McMillan, L. 2003. A new reconstruction filter for undersampled light fields. In Proceedings of the 14th Eurographics workshop on Rendering, Eurographics Association, 150--156.
31. Tompkin, J., Heinzle, S., Kautz, J., and Matusik, W. 2013. Content-adaptive lenticular prints. ACM Trans. Graph. 32, 4, 133:1--133:10.
32. Ye, G., State, A., and Fuchs, H. 2010. A practical multi-viewer tabletop autostereoscopic display. In Mixed and Augmented Reality (ISMAR), 2010 9th IEEE International Symposium on, IEEE, 147--156.
33. Yi, S.-Y., Chaeand, H.-B., and Lee, S.-H. 2008. Moving parallax barrier design for eye-tracking autostereoscopic displays. In 3DTV Conference.
34. Zhang, Z., Wang, L., Guo, B., and Shum, H.-Y. 2002. Feature-based light field morphing. ACM Trans. Graph. 21, 3, 457--464.
35. Zwicker, M., Matusik, W., Durand, F., and Pfister, H. 2006. Antialiasing for automultiscopic 3D displays. In Proceedings of the 17th Eurographics conference on Rendering Techniques, Eurographics Association, 73--82.

Index Terms

• Computing methodologies

  • Computer graphics

    • Image manipulation

    • Rendering