skip to main content
10.1145/1291233.1291461acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

Display pre-filtering for multi-view video compression

Published: 29 September 2007 Publication History

Abstract

Multi-view 3D displays are preferable to other stereoscopic display technologies because they provide autostereoscopic viewing from any viewpoint without special glasses. However, they require a large number of pixels to achieve high image quality. Therefore, data compression is a major issue for this approach. In this paper, we present a framework for efficient compression of multi-view video streams for multi-view 3D displays. Our goal is to optimize image quality without increasing the required data bandwidth. We achieve this by taking into account a precise notion of the multi-dimensional display bandwidth. The display bandwidth implies that scene elements that appear at a given distance from the display become increasingly blurry as the distance grows. Our main contribution is to enhance conventional multi-view compression pipelines with an additional pre-filtering step that bandlimits the multi-view signal to the display bandwidth. This imposes a shallow depth of field on the input images, thereby removing high frequency content. We show that this pre-filtering step leads to increased image quality compared to state-of-the-art multi-view coding at equal bitrate. We present results of an extensive user study that corroborate the benefits of our approach. Our work suggests that display pre-filtering will be a fundamental component in signal processing for 3D displays, and that any multi-view compression scheme will benefit from our pre-filtering technique.

References

[1]
T. Agocs, T. Balogh, T. Forgács, F. Bettio, E. Gobbetti, and G. Zanetti. A large scale interactive holographic display. In Proc. IEEE VR 2006 Workshop on Emerging Display Technologies, 2006.
[2]
J. X. Chai, S. C. Chan, H. Y. Shum, and X. Tong. Plenoptic sampling. In Computer Graphics, SIGGRAPH 2000 Proceedings, pages 307--318, Los Angeles, CA, July 2000.
[3]
A. Fitzgibbon, Y. Wexler, and A. Zisserman. Image-based rendering using image-based priors. International Journal of Computer Vision, 63(2):141--151, 2005.
[4]
S. Gortler, R. Grzeszczuk, R. Szeliski, and M. Cohen. The lumigraph. In Computer Graphics.
[5]
M. Halle. Holographic stereograms as discrete imaging systems. In Practical Holography VIII, volume 2176 of SPIE Proceedings, pages 73--84, 1994.
[6]
P. S. Hilaire. Modulation transfer function and optimum sampling of holographics stereograms. Applied Optics, 33(5), February 1994.
[7]
Holografika. Holovizio displays. http://www.holografika.com/, 2006. Cited September, 2006.
[8]
A. Isaksen, L. McMillan, and S. J. Gortler.Dynamically reparameterized light fields. In ComputerGraphics, SIGGRAPH 2000 Proc., July 2000.
[9]
ISO/IEC JTC1/SC29/WG11. Survey of algorithms used for multi-view video coding (MVC), MPEG document MPEG2005/N6909, January 2005.
[10]
ITU-T Rec. & ISO/IEC 14496-10 AVC. Advanced video coding for generic audiovisual services, 2005.
[11]
J. Konrad and P. Agniel. Subsampling models and anti-alias filters for 3-D automultiscopic displays. IEEE Trans. Image Proc., 2005.
[12]
M. Levoy and P. Hanrahan. Light field rendering. In Computer Graphics, SIGGRAPH 96 Proceedings, pages 31--42, New Orleans, LS, Aug. 1996.
[13]
L. Meesters, W. I.Jsselsteijn, and P. Seuntiens. A survey of perceptual evaluations and requirements of three-dimensional TV. IEEE Transactions on Circuits and Systems for Video Technology, (3):381--391, 2004.
[14]
P. Merkle, K. Müller, A. Smolic, and T. Wiegand. Efficient compression of multiview video exploiting inter-view dependencies based on H.264/AVC. InProc. IEEE Int'l Conf. Multimedia & Expo, 2006.
[15]
C. N. Moller and A. Travis. Correcting interperspective aliasing in autostereoscopic displays. IEEE Transactions on Visualization and Computer Graphics, 11(2):228--236, March/April 2005.
[16]
Newsight. http://www.newsight.com/, 2006. Cited January, 2006.
[17]
T. Okoshi. Three-Dimensional Imaging Techniques. Academic Press, 1976.
[18]
Y. Su, A. Vetro, and A. Smolic. Common test conditions for multiview video coding. Doc.JVT-U211, available online at http://ftp3.itu.ch/av-arch/jvt-site/, 2006.
[19]
C. L. Zitnick, S. B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski. High-quality video view interpolation using a layered representation. ACM Trans. Graph., 23(3):600--608, 2004.
[20]
M. Zwicker, W. Matusik, F. Durand, and H. Pfister. Antialiasing for automultiscopic 3d displays. In Eurographics Symposium on Rendering, 2006.

Cited By

View all
  • (2018)Efficient multi-view ray tracing using edge detection and shader reuseThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-011-0560-427:6-8(665-676)Online publication date: 28-Dec-2018
  • (2017)Perceptual Depth Quality in Distorted Stereoscopic ImagesIEEE Transactions on Image Processing10.1109/TIP.2016.264279126:3(1202-1215)Online publication date: 1-Mar-2017
  • (2015)Depth perception of distorted stereoscopic images2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP)10.1109/MMSP.2015.7340832(1-6)Online publication date: Oct-2015
  • Show More Cited By

Index Terms

  1. Display pre-filtering for multi-view video compression

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '07: Proceedings of the 15th ACM international conference on Multimedia
    September 2007
    1115 pages
    ISBN:9781595937025
    DOI:10.1145/1291233
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 September 2007

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. 3D displays
    2. antialiasing
    3. multi-view compression

    Qualifiers

    • Article

    Conference

    MM07

    Acceptance Rates

    Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)2
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 14 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2018)Efficient multi-view ray tracing using edge detection and shader reuseThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-011-0560-427:6-8(665-676)Online publication date: 28-Dec-2018
    • (2017)Perceptual Depth Quality in Distorted Stereoscopic ImagesIEEE Transactions on Image Processing10.1109/TIP.2016.264279126:3(1202-1215)Online publication date: 1-Mar-2017
    • (2015)Depth perception of distorted stereoscopic images2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP)10.1109/MMSP.2015.7340832(1-6)Online publication date: Oct-2015
    • (2015)Large-scale human action recognition with spark2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP)10.1109/MMSP.2015.7340818(1-6)Online publication date: Oct-2015
    • (2014)Visual Quality Assessment of Stereoscopic Image and Video: Challenges, Advances, and Future TrendsVisual Signal Quality Assessment10.1007/978-3-319-10368-6_7(185-212)Online publication date: 16-Oct-2014
    • (2011)Frequency analysis and sheared filtering for shadow light fields of complex occludersACM Transactions on Graphics10.1145/1944846.194484930:2(1-13)Online publication date: 22-Apr-2011
    • (2011)Spatioangular Prefiltering for Multiview 3D DisplaysIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2010.8617:5(642-654)Online publication date: 1-May-2011
    • (2010)Spatio-angular sharpening for multiview 3D displays2010 IEEE International Conference on Acoustics, Speech and Signal Processing10.1109/ICASSP.2010.5495013(750-753)Online publication date: Mar-2010
    • (2008)Spatial and temporal sampling control for visual surveillance application2008 IEEE International Conference on Systems, Man and Cybernetics10.1109/ICSMC.2008.4811395(903-908)Online publication date: Oct-2008
    • (2008)Disparity Adaptive Filter for Anti-Aliasing of Stereoscopic 3D Images2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video10.1109/3DTV.2008.4547803(41-44)Online publication date: May-2008
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media