Changil Kim
Simon Heinzle
Wojciech Matusik
Abstract
This paper addresses stereoscopic view generation from a light field. We present a framework that allows for the generation of stereoscopic image pairs with per-pixel control over disparity, based on multi-perspective imaging from light fields. The proposed framework is novel and useful for stereoscopic image processing and post-production. The stereoscopic images are computed as piecewise continuous cuts through a light field, minimizing an energy reflecting prescribed parameters such as depth budget, maximum disparity gradient, desired stereoscopic baseline, and so on. As demonstrated in our results, this technique can be used for efficient and flexible stereoscopic post-processing, such as reducing excessive disparity while preserving perceived depth, or retargeting of already captured scenes to various view settings. Moreover, we generalize our method to multiple cuts, which is highly useful for content creation in the context of multi-view autostereoscopic displays. We present several results on computer-generated content as well as live-action content.
Supplemental Material
- Adelson, E., and Bergen, J. 1991. The plenoptic function and the elements of early vision. Computational Models of Visual Processing, 3--20.Google Scholar
- Adelson, E. H., and Wang, J. 1992. Single lens stereo with a plenoptic camera. IEEE PAMI 14, 2, 99--106. Google ScholarDigital Library
- Agrawal, A., and Raskar, R. 2007. Gradient domain manipulation techniques in vision and graphics. In ICCV Courses.Google Scholar
- Boykov, Y., and Kolmogorov, V. 2004. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE PAMI 26, 9, 1124--1137. Google ScholarDigital Library
- Boykov, Y., Veksler, O., and Zabih, R. 2001. Fast approximate energy minimization via graph cuts. IEEE PAMI 23, 11, 1222--1239. Google ScholarDigital Library
- Chai, J., Chan, S.-C., Shum, H.-Y., and Tong, X. 2000. Plenoptic sampling. In SIGGRAPH, 307--318. Google ScholarDigital Library
- Didyk, P., Ritschel, T., Eisemann, E., Myszkowski, K., and Seidel, H.-P. 2011. A perceptual model for disparity. In SIGGRAPH, 96:1--96:10. Google ScholarDigital Library
- Feldmann, I., Schreer, O., and Kauff, P. 2003. Nonlinear depth scaling for immersive video applications. In WIAMIS.Google Scholar
- Georgiev, T., Zheng, C., Nayar, S., Curless, B., Salesin, D., and Intwala, C. 2006. Spatio-angular resolution tradeoffs in integral photography. In EGSR, 263--272. Google ScholarCross Ref
- Gortler, S. J., Grzeszczuk, R., Szeliski, R., and Cohen, M. F. 1996. The Lumigraph. In SIGGRAPH, 43--54. Google ScholarDigital Library
- Hartley, R. I., and Gupta, R. 1997. Linear pushbroom cameras. IEEE PAMI 19, 9, 963--975. Google ScholarDigital Library
- Held, R. T., and Banks, M. S. 2008. Misperceptions in stereoscopic displays: A vision science perspective. In APGV, 23--32. Google ScholarDigital Library
- Holliman, N. 2004. Mapping perceived depth to regions of interest in stereoscopic images. In SPIE, vol. 5291, 117--128.Google Scholar
- Jones, G., Lee, D., Holliman, N., and Ezra, D. 2001. Controlling perceived depth in stereoscopic images. In SPIE, vol. 4297, 42--53.Google Scholar
- Kang, S. B., and Szeliski, R. 2004. Extracting view-dependent depth maps from a collection of images. IJCV 58, 2, 139--163. Google ScholarDigital Library
- Kim, M., Lee, S., Choi, C., Um, G.-M., Hur, N., and Kim, J. 2008. Depth scaling of multiview images for automultiscopic 3D monitors. In 3DTV-CON, 181--184.Google Scholar
- Koppal, S. J., Zitnick, C. L., Cohen, M. F., Kang, S. B., Ressler, B., and Colburn, A. 2011. A viewer-centric editor for 3D movies. IEEE CG&A 31, 1, 20--35. Google ScholarDigital Library
- Lang, M., Hornung, A., Wang, O., Poulakos, S., Smolic, A., and Gross, M. 2010. Nonlinear disparity mapping for stereoscopic 3D. In SIGGRAPH, 75:1--75:10. Google ScholarDigital Library
- Levoy, M., and Hanrahan, P. 1996. Light field rendering. In SIGGRAPH, 31--42. Google ScholarDigital Library
- Mendiburu, B. 2009. 3D Movie Making: Stereoscopic Digital Cinema from Script to Screen. Focal Press.Google Scholar
- Neuman, R., 2010. Personal Communication with Robert Neuman, Chief Stereographer, Disney Animation Studios.Google Scholar
- Ng, R., Levoy, M., Brédif, M., Duval, G., Horowitz, M., and Hanrahan, P. 2005. Light field photography with a hand-held plenoptic camera. Technical Report CSTR 2005-02, Stanford University.Google Scholar
- Pajdla, T. 2002. Geometry of two-slit camera. Research Report CTU-CMP-2002-02, Czech Technical University.Google Scholar
- Peleg, S., Ben-Ezra, M., and Pritch, Y. 2001. Omnistereo: Panoramic stereo imaging. IEEE PAMI 23, 3, 279--290. Google ScholarDigital Library
- Rademacher, P., and Bishop, G. 1998. Multiple-center-of-projection images. In SIGGRAPH, 199--206. Google ScholarDigital Library
- Rubinstein, M., Shamir, A., and Avidan, S. 2008. Improved seam carving for video retargeting. In SIGGRAPH, 16:1--16:9. Google ScholarDigital Library
- Seitz, S. 2001. The space of all stereo images. In IEEE ICCV, vol. 1, 26--33.Google Scholar
- Thomas, F., and Johnston, O. 1995. The Illusion of Life: Disney Animation. Hyperion.Google Scholar
- Veeraraghavan, A., Raskar, R., Agrawal, A. K., Mohan, A., and Tumblin, J. 2007. Dappled photography: Mask enhanced cameras for heterodyned light fields and coded aperture refocusing. In SIGGRAPH, 69:1--69:12. Google ScholarDigital Library
- Ward, B., Kang, S. B., and Bennett, E. P. 2011. Depth director: A system for adding depth to movies. IEEE CG&A 31, 1, 36--48. Google ScholarDigital Library
- Wilburn, B., Joshi, N., Vaish, V., Talvala, E.-V., Antunez, E., Barth, A., Adams, A., Horowitz, M., and Levoy, M. 2005. High performance imaging using large camera arrays. In SIGGRAPH, 765--776. Google ScholarDigital Library
- Wood, D. N., Finkelstein, A., Hughes, J. F., Thayer, C. E., and Salesin, D. H. 1997. Multiperspective panoramas for cel animation. In SIGGRAPH, 243--250. Google ScholarDigital Library
- Woods, A., Docherty, T., and Koch, R. 1993. Image distortions in stereoscopic video systems. In SPIE, vol. 1915, 36--48.Google Scholar
- Yang, J. C., Everett, M., Buehler, C., and McMillan, L. 2002. A real-time distributed light field camera. In EGWR, 77--86. Google ScholarDigital Library
- Yu, J., and McMillan, L. 2004. General linear cameras. In ECCV, 14--27.Google Scholar
- Yu, J., McMillan, L., and Sturm, P. 2010. Multi-perspective modelling, rendering and imaging. Computer Graphics Forum 29, 1, 227--246.Google ScholarCross Ref
- Zomet, A., Feldman, D., Peleg, S., and Weinshall, D. 2003. Mosaicing new views: The crossed-slits projection. IEEE PAMI 25, 6, 741--754. Google ScholarDigital Library
- Zwicker, M., Matusik, W., Durand, F., and Pfister, H. 2006. Antialiasing for automultiscopic 3D displays. In EGSR. Google ScholarDigital Library
Index Terms
- Multi-perspective stereoscopy from light fields
Recommendations
Multi-perspective stereoscopy from light fields
SA '11: Proceedings of the 2011 SIGGRAPH Asia ConferenceThis paper addresses stereoscopic view generation from a light field. We present a framework that allows for the generation of stereoscopic image pairs with per-pixel control over disparity, based on multi-perspective imaging from light fields. The ...
Memory Efficient Stereoscopy from Light Fields
3DV '14: Proceedings of the 2014 2nd International Conference on 3D Vision - Volume 01We address the problem of stereoscopic content generation from light fields using multi-perspective imaging. Our proposed method takes as input a light field and a target disparity map, and synthesizes a stereoscopic image pair by selecting light rays ...
Camera array calibration for light field acquisition
Light field cameras are becoming popular in computer vision and graphics, with many research and commercial applications already having been proposed. Various types of cameras have been developed with the camera array being one of the ways of acquiring ...
Comments