research-article

Free access

Depth of field postprocessing for layered scenes using constant-time rectangle spreading

Authors:

Todd J. Kosloff,

Michael W. Tao,

Brian A. BarskyAuthors Info & Claims

GI '09: Proceedings of Graphics Interface 2009

Pages 39 - 46

Published: 25 May 2009 Publication History

Abstract

Control over what is in focus and what is not in focus in an image is an important artistic tool. The range of depth in a 3D scene that is imaged in sufficient focus through an optics system, such as a camera lens, is called depth of field. Without depth of field, the entire scene appears completely in sharp focus, leading to an unnatural, overly crisp appearance. Current techniques for rendering depth of field in computer graphics are either slow or suffer from artifacts, or restrict the choice of point spread function (PSF). In this paper, we present a new image filter based on rectangle spreading which is constant time per pixel. When used in a layered depth of field framework, our filter eliminates the intensity leakage and depth discontinuity artifacts that occur in previous methods. We also present several extensions to our rectangle spreading method to allow flexibility in the appearance of the blur through control over the PSF.

References

[1]

B. A. Barsky. Vision-realistic rendering: simulation of the scanned foveal image from wavefront data of human subjects. In APGV '04: Proceedings of the 1st Symposium on Applied perception in graphics and visualization, pages 73--81, New York, NY, USA, August 2004. ACM.

Digital Library

[2]

B. A. Barsky, D. R. Horn, S. A. Klein, J. A. Pang, and M. Yu. Camera models and optical systems used in computer graphics: Part i, objectbased techniques. In Proceedings of the 2003 International Conference on Computational Science and its Applications (ICCSA '03), pages 246--255, May 2003.

Digital Library

[3]

B. A. Barsky, D. R. Horn, S. A. Klein, J. A. Pang, and M. Yu. Camera models and optical systems used in computer graphics: Part ii, imagebased techniques. In Proceedings of the 2003 International Conference on Computational Science and its Applications (ICCSA '03), pages 256--265, May 2003.

Digital Library

[4]

B. A. Barsky, M. J. Tobias, D. Chu, and D. R. Horn. Elimination of artifacts due to occlusion and discretization problems in image space blurring techniques. Graphical Models 67(6), pages 584--599, November 2005.

Digital Library

[5]

B. A. Barsky, M. J. Tobias, D. R. Horn, and D. Chu. Investigating occlusion and discretization problems in image space blurring techniques. In First International Conference on Vision, Video, and Graphics, pages 97--102, July 2003.

[6]

M. Bertalmio, P. Fort, and D. Sanchez-Crespo. Real-time, accurate depth of field using anisotropic diffusion and programmable graphics cards. In Proceedings of the 2nd International Symposium on 3D Data Processing, Visualization and Transmission 3DPVT 2004, pages 767--773, 6--9 Sept. 2004.

Digital Library

[7]

E. Catmull. An analytic visible surface algorithm for independent pixel processing. In SIGGRAPH 1984 Conference Proceedings, pages 109--115. ACM Press, 1984.

Digital Library

[8]

R. Cook, T. Porter, and L. Carpenter. Distributed ray tracing. In ACM SIGGRAPH 1984 Conference Proceedings, pages 137--145, 1984.

Digital Library

[9]

F. C. Crow. Summed-area tables for texture mapping. In SIGGRAPH '84: Proceedings of the 11th annual conference on Computer graphics and interactive techniques, pages 207--212, New York, NY, USA, 1984. ACM Press.

Digital Library

[10]

J. Demers. Depth of field: A survey of techniques. GPU Gems, pages 375--390, 2004.

[11]

P. Fearing. Importance ordering for real-time depth of field. In Proceedings of the Third International Computer Science Conference on Image Analysis Applications and Computer Graphics, volume 1024, pages 372--380. Springer-Verlag Lecture Notes in Computer Science, 1995.

Digital Library

[12]

A. Fournier and E. Fiume. Constant-time filtering with space-variant kernels. In SIGGRAPH '88: Proceedings of the 15th annual conference on Computer graphics and interactive techniques, pages 229--238, New York, NY, USA, 1988. ACM.

Digital Library

[13]

M. Frigo and S. G. Johnson. The design and implementation of fftw3. Proceedings of the IEEE 93 (2) Special Issue on Program Generation, Optimization, and Platform Adaptation, 93(2):216--231, Feb. 2005.

[14]

C. Gotsman. Constant-time filtering by singular value decomposition. Computer Graphics Forum, pages 153--163, 1994.

[15]

P. Haeberli and K. Akeley. The accumulation buffer: hardware support for high-quality rendering. In SIGGRAPH '90: Proceedings of the 17th annual conference on Computer graphics and interactive techniques, pages 309--318, New York, NY, USA, 1990. ACM.

Digital Library

[16]

P. S. Heckbert. Filtering by repeated integration. In SIGGRAPH '86: Proceedings of the 13th annual conference on Computer graphics and interactive techniques, pages 315--321, New York, NY, USA, 1986. ACM Press.

Digital Library

[17]

J. Hensley, T. Scheuermann, G. Coombe, M. Singh, and A. Lastra. Fast summed-area table generation and its applications. In Eurographics 2005, 2005.

[18]

T. Huang, G. Yang, and G. Yang. A fast two-dimensional median filtering algorithm. IEEE Transactions on Acoustics, Speech, and Signal Processing v. 27, pages 13--18, 1979.

[19]

M. Kass, A. Lefohn, and J. Owens. Interactive depth of field. Pixar Technical Memo 06--01, 2006.

[20]

C. Kolb, D. Mitchell, and P. Hanrahan. A realistic camera model for computer graphics. In SIGGRAPH '95: Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, pages 317--324, New York, NY, USA, 1995. ACM.

Digital Library

[21]

M. Kraus and M. Strengert. Depth of field rendering by pyramidal image processing. Computer Graphics Forum 26(3), 2007.

[22]

J. Krivanek, J. Zara, and K. Bouatouch. Fast depth of field rendering with surface splatting. In Computer Graphics International 2003, 2003.

[23]

J. Mulder and R. van Lier. Fast perception-based depth of field rendering. In Proceedings of the ACM symposium on Virtual reality software and technology, pages 129--133, 2000.

Digital Library

[24]

S. Perreault and P. Hebert. Median filtering in constant time. IEEE Transactions on Image Processing 16(9), pages 2389--2394, 2007.

Digital Library

[25]

T. Porter and T. Duff. Compositing digital images. In ACM SIGGRAPH 1984 Conference Proceedings, pages 253--259, New York, NY, USA, 1984. ACM.

Digital Library

[26]

M. Potmesil and I. Chakravarty. Synthetic image generation with a lens and aperture camera model. ACM Transactions on Graphics 1(2), pages 85--108, 1982.

Digital Library

[27]

P. Rokita. Generating depth-of-field effects in virtual reality applications. IEEE Computer Graphics and Applications 16(2), pages 18--21, 1996.

Digital Library

[28]

T. Scheuermann and N. Tatarchuk. Advanced depth of field rendering. In ShaderX3: Advanced Rendering with DirectX and OpenGL, 2004.

[29]

C. Scofield. 2 1/2-d depth of field simulation for computer animation. In Graphics Gems III. Morgan Kaufmann, 1994.

Digital Library

[30]

M. Shinya. Post-filtering for depth of field simulation with ray distribution buffer. In Proceedings of Graphics Interface '94, pages 59--66. Canadian Information Processing Society, 1994.

[31]

T. Zhou, J. X. Chen, and M. Pullen. Accurate depth of field simulation in real time. Computer Graphics Forum 26(1), pages 15--23, 2007.

Cited By

Selgrad KReintges CPenk DWagner PStamminger MKeyser JSander PSubr KWei L(2015)Real-time depth of field using multi-layer filteringProceedings of the 19th Symposium on Interactive 3D Graphics and Games10.1145/2699276.2699288(121-127)Online publication date: 27-Feb-2015
https://dl.acm.org/doi/10.1145/2699276.2699288
Zhang XXue WWang ZSheng BMa LLi PJin XMagnenat-Thalmann NYang HYang XBednarz TFujishiro I(2014)Saliency-based depth-of-field rendering with flash and non-flash pairsProceedings of the 13th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry10.1145/2670473.2670494(133-140)Online publication date: 30-Nov-2014
https://dl.acm.org/doi/10.1145/2670473.2670494
Yu KWu SSheng BMa LWang CMagnenat-Thalmann NPan Z(2013)Layered depth-of-field rendering using color spreadingProceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry10.1145/2534329.2534340(77-82)Online publication date: 17-Nov-2013
https://dl.acm.org/doi/10.1145/2534329.2534340
Show More Cited By

Index Terms

Depth of field postprocessing for layered scenes using constant-time rectangle spreading
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
    2. Rendering

Recommendations

Layered depth-of-field rendering using color spreading
VRCAI '13: Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry

Depth of field (DoF) is a depth range outside of which objects are blurred. DoF has been widely used in photography and films by artists and is expected to be applied to realistic image rendering and virtual reality applications in the area of computer ...
Fast indirect illumination using Layered Depth Images

We present a novel hybrid rendering method for diffuse and glossy indirect illumination. A scene is rendered using standard rasterization on a GPU. In a shader, secondary ray queries are used to sample incident light and to compute indirect lighting. We ...
Real-time depth of field using multi-layer filtering
i3D '15: Proceedings of the 19th Symposium on Interactive 3D Graphics and Games

We present a novel technique for rendering depth of field that addresses difficult overlap cases, such as close, but out-of-focus, geometry in the near-field. Such scene configurations are not managed well by state-of-the-art post-processing approaches ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

GI '09: Proceedings of Graphics Interface 2009

May 2009

257 pages

ISBN:9781568814704

Program Chairs:
Amy Gooch
University of Victoria, Canada
,
Melanie Tory
University of Victoria, Canada

Sponsors

The Canadian Human-Computer Communications Society / Société Canadienne du Dialogue Humaine Machine (CHCCS/SCDHM)

Publisher

Canadian Information Processing Society

Canada

Publication History

Published: 25 May 2009

Qualifiers

Research-article

Acceptance Rates

GI '09 Paper Acceptance Rate 28 of 77 submissions, 36%;

Overall Acceptance Rate 206 of 508 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
385
Total Downloads

Downloads (Last 12 months)44
Downloads (Last 6 weeks)7

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Selgrad KReintges CPenk DWagner PStamminger MKeyser JSander PSubr KWei L(2015)Real-time depth of field using multi-layer filteringProceedings of the 19th Symposium on Interactive 3D Graphics and Games10.1145/2699276.2699288(121-127)Online publication date: 27-Feb-2015
https://dl.acm.org/doi/10.1145/2699276.2699288
Zhang XXue WWang ZSheng BMa LLi PJin XMagnenat-Thalmann NYang HYang XBednarz TFujishiro I(2014)Saliency-based depth-of-field rendering with flash and non-flash pairsProceedings of the 13th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry10.1145/2670473.2670494(133-140)Online publication date: 30-Nov-2014
https://dl.acm.org/doi/10.1145/2670473.2670494
Yu KWu SSheng BMa LWang CMagnenat-Thalmann NPan Z(2013)Layered depth-of-field rendering using color spreadingProceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry10.1145/2534329.2534340(77-82)Online publication date: 17-Nov-2013
https://dl.acm.org/doi/10.1145/2534329.2534340
Lei KHughes JMeenakshisundaram GYoon SOlano MOtaduy M(2013)Approximate depth of field effects using few samples per pixelProceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games10.1145/2448196.2448215(119-128)Online publication date: 21-Mar-2013
https://dl.acm.org/doi/10.1145/2448196.2448215
Shirley PAila TCohen JEnderton ELaine SLuebke DMcGuire MGarland MWang R(2011)A local image reconstruction algorithm for stochastic renderingSymposium on Interactive 3D Graphics and Games10.1145/1944745.1944747(9-14 PAGE@5)Online publication date: 18-Feb-2011
https://dl.acm.org/doi/10.1145/1944745.1944747
Lee SEisemann ESeidel HDeRose T(2010)Real-time lens blur effects and focus controlACM SIGGRAPH 2010 papers10.1145/1833349.1778802(1-7)Online publication date: 26-Jul-2010
https://dl.acm.org/doi/10.1145/1833349.1778802
Lee SEisemann ESeidel H(2010)Real-time lens blur effects and focus controlACM Transactions on Graphics10.1145/1778765.177880229:4(1-7)Online publication date: 26-Jul-2010
https://dl.acm.org/doi/10.1145/1778765.1778802
Lee SEisemann ESeidel HInakage M(2009)Depth-of-field rendering with multiview synthesisACM SIGGRAPH Asia 2009 papers10.1145/1661412.1618480(1-6)Online publication date: 17-Dec-2009
https://dl.acm.org/doi/10.1145/1661412.1618480
Lee SEisemann ESeidel H(2009)Depth-of-field rendering with multiview synthesisACM Transactions on Graphics10.1145/1618452.161848028:5(1-6)Online publication date: 1-Dec-2009
https://dl.acm.org/doi/10.1145/1618452.1618480
Robison AShirley PLuebke DSlusallek P(2009)Image space gatheringProceedings of the Conference on High Performance Graphics 200910.1145/1572769.1572784(91-98)Online publication date: 1-Aug-2009
https://dl.acm.org/doi/10.1145/1572769.1572784

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten