research-article

Perspective-aware warping for seamless stereoscopic image cloning

Authors:

Wen-Huang Cheng,

Yung-Yu ChuangAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 31, Issue 6

Article No.: 182, Pages 1 - 8

https://doi.org/10.1145/2366145.2366201

Published: 01 November 2012 Publication History

Abstract

This paper presents a novel technique for seamless stereoscopic image cloning, which performs both shape adjustment and color blending such that the stereoscopic composite is seamless in both the perceived depth and color appearance. The core of the proposed method is an iterative disparity adaptation process which alternates between two steps: disparity estimation, which re-estimates the disparities in the gradient domain so that the disparities are continuous across the boundary of the cloned region; and perspective-aware warping, which locally re-adjusts the shape and size of the cloned region according to the estimated disparities. This process guarantees not only depth continuity across the boundary but also models local perspective projection in accordance with the disparities, leading to more natural stereoscopic composites. The proposed method allows for easy cloning of objects with intricate silhouettes and vague boundaries because it does not require precise segmentation of the objects. Several challenging cases are demonstrated to show that our method generates more compelling results compared to methods with only global shape adjustment.

Supplementary Material

ZIP File (182-174-0048.zip)

Supplemental Materials for Perspective-aware warping for seamless stereoscopic image cloning

Download
41.77 MB

References

[1]

Basha, T., Moses, Y., and Avidan, S. 2011. Geometrically consistent stereo seam carving. In Proc. IEEE ICCV '11, 1816--1823.

Digital Library

[2]

Carroll, R., Agarwala, A., and Agrawala, M. 2010. Image warps for artistic perspective manipulation. ACM TOG 29, 4, 127:1--127:9.

Digital Library

[3]

Chang, C.-H., Liang, C.-K., and Chuang, Y.-Y. 2011. Content-aware display adaptation and interactive editing for stereoscopic images. IEEE TMM 13, 4, 589--601.

Digital Library

[4]

Chen, T., Cheng, M.-M., Tan, P., Shamir, A., and Hu, S.-M. 2009. Sketch2Photo: internet image montage. ACM TOG 28, 5, 124:1--124:10.

Digital Library

[5]

Ding, M., and Tong, R.-F. 2010. Content-aware copying and pasting in images. The Visual Computer 26, 6--8, 721--729.

Digital Library

[6]

Farbman, Z., Hoffer, G., Lipman, Y., Cohen-Or, D., and Lischinski, D. 2009. Coordinates for instant image cloning. ACM TOG 28, 3, 67:1--67:9.

Digital Library

[7]

Igarashi, T., Moscovich, T., and Hughes, J. F. 2005. As-rigid-as-possible shape manipulation. ACM TOG 24, 3, 1134--1141.

Digital Library

[8]

Jia, J., Sun, J., Tang, C.-K., and Shum, H.-Y. 2006. Drag-and-drop pasting. ACM TOG 25, 3, 631--637.

Digital Library

[9]

Kim, C., Hornung, A., Heinzle, S., Matusik, W., and Gross, M. 2011. Multi-perspective stereoscopy from light fields. ACM TOG 30, 6, 190:1--190:10.

Digital Library

[10]

Kim, J., Hoffman, D. M., and Banks, M. S. 2011. The zone of comfort: Predicting visual discomfort with stereo displays. Journal of Vision 11, 8, 1--29.

[11]

Koppal, S., Zitnick, C. L., Cohen, M., Kang, S. B., Ressler, B., and Colburn, A. 2011. A viewer-centric editor for 3D movies. IEEE CG&A 31, 1, 20--35.

Digital Library

[12]

Lalonde, J.-F., Hoiem, D., Efros, A. A., Rother, C., Winn, J., and Criminisi, A. 2007. Photo clip art. ACM TOG 26, 3, 3:1--3:10.

Digital Library

[13]

Lambooij, M. T. M., IJsselsteijn, W. A., and Heynderickx, I. 2007. Visual discomfort in stereoscopic displays: a review. In Proc. SPIE, vol. 6490, 64900I.

[14]

Lang, M., Hornung, A., Wang, O., Poulakos, S., Smolic, A., and Gross, M. 2010. Nonlinear disparity mapping for stereoscopic 3D. ACM TOG 29, 4, 75:1--75:10.

Digital Library

[15]

Liu, F., Gleicher, M., Jin, H., and Agarwala, A. 2009. Content-preserving warps for 3D video stabilization. ACM TOG 28, 3, 44:1--44:9.

Digital Library

[16]

Lo, W.-Y., van Baar, J., Knaus, C., Zwicker, M., and Gross, M. 2010. Stereoscopic 3D copy & paste. ACM TOG 29, 6, 147:1--147:10.

Digital Library

[17]

Lowe, D. G. 2004. Distinctive image features from scale-invariant keypoints. IJCV 60, 2, 91--110.

Digital Library

[18]

Mendiburu, B. 2009. 3D Movie Making: Stereoscopic Digital Cinema from Script to Screen. Focal Press.

[19]

Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM TOG 22, 3, 313--318.

Digital Library

[20]

Schaefer, S., McPhail, T., and Warren, J. 2006. Image deformation using moving least squares. ACM TOG 25, 3, 533--540.

Digital Library

[21]

Shamir, A., and Sorkine, O. 2009. Visual media retargeting. In ACM SIGGRAPH Asia '09 Courses, 11:1--11:13.

Digital Library

[22]

Smith, B., Zhang, L., and Jin, H. 2009. Stereo matching with nonparametric smoothness priors in feature space. In Proc. IEEE CVPR '09, 485--492.

[23]

Wang, J., and Cohen, M. F. 2007. Simultaneous matting and compositing. In Proc. IEEE CVPR '07, 1--8.

[24]

Wang, L., Jin, H., Yang, R., and Gong, M. 2008. Stereoscopic inpainting: Joint color and depth completion from stereo images. In Proc. IEEE CVPR '08.

[25]

Wang, Y.-S., Tai, C.-L., Sorkine, O., and Lee, T.-Y. 2008. Optimized scale-and-stretch for image resizing. ACM TOG 27, 5, 118:1--118:8.

Digital Library

[26]

Yang, W., Zheng, J., Cai, J., Rahardja, S., and Chen, C. W. 2009. Natural and seamless image composition with color control. IEEE TIP 18, 11, 2584--2592.

Digital Library

Cited By

Huang KZhang FZhao JLi YDodgson N(2024)360 Stereo Image Composition With Depth AdaptionIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332794330:9(6177-6191)Online publication date: Sep-2024
https://doi.org/10.1109/TVCG.2023.3327943
Chai XShao FJiang QHo Y(2021)Roundness-Preserving Warping for Aesthetic Enhancement-Based Stereoscopic Image EditingIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2020.301018131:4(1463-1477)Online publication date: Apr-2021
https://doi.org/10.1109/TCSVT.2020.3010181
Shao FFei YJiang QMeng XHo Y(2020)Building stereoscopic zoomer via global and local warping optimizationIEEE Transactions on Computational Imaging10.1109/TCI.2020.3042891(1-1)Online publication date: 2020
https://doi.org/10.1109/TCI.2020.3042891
Show More Cited By

Index Terms

Perspective-aware warping for seamless stereoscopic image cloning
1. Computing methodologies
  1. Computer graphics

Recommendations

Enabling warping on stereoscopic images

Warping is one of the basic image processing techniques. Directly applying existing monocular image warping techniques to stereoscopic images is problematic as it often introduces vertical disparities and damages the original disparity distribution. In ...
Omni-Directional Stereoscopic Images from One Omni-Directional Camera

Omni-directional stereoscopic images consist of two of omni-directional panoramic images, where each image is for the left eye and the right eye. The panoramic stereoscopic image provides a stereo sensation in a full 360 view. These omni-directional ...
Changing Perspective in Stereoscopic Images

Traditional image editing techniques cannot be directly used to edit stereoscopic ("3D”) media, as extra constraints are needed to ensure consistent changes are made to both left and right images. Here, we consider manipulating perspective in ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 31, Issue 6

November 2012

794 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/2366145

Issue’s Table of Contents

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2012

Published in TOG Volume 31, Issue 6

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Council Taiwan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

45
Total Citations
View Citations
740
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)1

Reflects downloads up to 18 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Huang KZhang FZhao JLi YDodgson N(2024)360 Stereo Image Composition With Depth AdaptionIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332794330:9(6177-6191)Online publication date: Sep-2024
https://doi.org/10.1109/TVCG.2023.3327943
Chai XShao FJiang QHo Y(2021)Roundness-Preserving Warping for Aesthetic Enhancement-Based Stereoscopic Image EditingIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2020.301018131:4(1463-1477)Online publication date: Apr-2021
https://doi.org/10.1109/TCSVT.2020.3010181
Shao FFei YJiang QMeng XHo Y(2020)Building stereoscopic zoomer via global and local warping optimizationIEEE Transactions on Computational Imaging10.1109/TCI.2020.3042891(1-1)Online publication date: 2020
https://doi.org/10.1109/TCI.2020.3042891
Khayotov MHan J(2020)Efficient Stitching Algorithm for Stereoscopic VR Images2020 IEEE International Conference on Consumer Electronics - Asia (ICCE-Asia)10.1109/ICCE-Asia49877.2020.9277028(1-5)Online publication date: 1-Nov-2020
https://doi.org/10.1109/ICCE-Asia49877.2020.9277028
Islam MWong LLow KWong C(2019)Warping-Based Stereoscopic 3D Video Retargeting With Depth Remapping2019 IEEE Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV.2019.00181(1655-1663)Online publication date: Jan-2019
https://doi.org/10.1109/WACV.2019.00181
Xie DLiu SWang YZhu SZeng B(2019)View-Consistent Intrinsic Decomposition for Stereoscopic ImagesIEEE Access10.1109/ACCESS.2019.29435167(140355-140366)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2943516
Shao FShen LJiang QLi FHo Y(2019)User Controllable Content Retargeting and Depth Adaptation for Stereoscopic DisplayIEEE Access10.1109/ACCESS.2019.28920987(22541-22553)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2892098
Venkata HAlsadoon APrasad PAlsadoon OHaddad SDeva AHsu J(2019)A novel mixed reality in breast and constructive jaw surgical tele-presenceComputer Methods and Programs in Biomedicine10.1016/j.cmpb.2019.05.025177:C(253-268)Online publication date: 1-Aug-2019
https://dl.acm.org/doi/10.1016/j.cmpb.2019.05.025
Wu LGao YYu MJian MLiu ZGuan YZafar NZhou K(2018)Global-optimization-based model decomposition for support-free multi-DOF 3D printingSIGGRAPH Asia 2018 Posters10.1145/3283289.3283352(1-2)Online publication date: 4-Dec-2018
https://dl.acm.org/doi/10.1145/3283289.3283352
Li XHuang HWang YHu M(2018)Geodesic distance framework for contour-based consistent stereo image segmentationJournal of Electronic Imaging10.1117/1.JEI.27.5.05304727:05(1)Online publication date: 29-Oct-2018
https://doi.org/10.1117/1.JEI.27.5.053047
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents