skip to main content
10.1145/1180495.1180536acmconferencesArticle/Chapter ViewAbstractPublication PagesvrstConference Proceedingsconference-collections
Article

Interactive editing of segmented volumetric datasets in a hybrid 2D/3D virtual environment

Published: 01 November 2006 Publication History

Abstract

In this paper we present a novel system for segmentation refine-ment, which allows for interactive correction of surface models generated from imperfect automatic segmentations of arbitrary volumetric data. The proposed approach is based on a deformable surface model allowing interactive manipulation with a hybrid user interface consisting of an immersive stereoscopic display and a Tablet PC. The user interface features visualization methods and manipulation tools specifically designed for quick inspection and correction of typical defects resulting from automated segmentation of medical datasets. A number of experiments show that typical segmentation problems can be fixed within a few minutes using the system, while maintaining real-time responsiveness of the system.

References

[1]
W. A. Barret and E. N. Mortensen. Interactive live-wire boundary extraction. Medical Image Analysis, 1(4):331--341, 1997.
[2]
R. Beichel. Virtual Liver Surgery Planning: Segmentation of CT Data. PhD thesis, Graz University of Technology, 2005.
[3]
R. Beichel, S. Mitchell, E. Sorantin, F. Leberl, A. Goshtasby,mand M. Sonka. Shape- and appearance-based segmentation of volumetric medical images. In Proc. of ICIP 2001, volume 2, pages 589--592.
[4]
F. L. Bookstein. Principal warps: Thin-plate splines and them decomposition of deformations. IEEE Trans. Pattern Anal. Mach. Intell., 11(6):567--585, 1989.
[5]
A. Bornik, R. Beichel, and et al. A hybrid user interface for manipulation of volumetric medical data. In Proc. of IEEE Symposium on 3D User Interfaces 2006, pages 29--36.
[6]
A. Bornik, R. Beichel, B. Reitinger, G. Gotschuli, E. Sorantin, F. Leberl, and M. Sonka. Computer aided liver surgery planning: An augmented reality approach. In Proc. of SPIE 2003, volume 5029.
[7]
Y. Boykov and M.-P. Jolly. Interactive organ segmentation using graph cuts. In Proc. of MICCAI 2000, pages 276--286.
[8]
H. Delingette. General object reconstruction based on simplex meshes. International Journal of Computer Vision, 32(2): 111--146.
[9]
G. Donato and S. Belongie. Approximation methods for thin plate spline mappings and principal warps. In Proc. of ECCV 2002, pages 21--31.
[10]
T. Emerson, J. Prothero, and S. Weghorst. Medicine and virtual reality: A guide to the the literature (MedVR). Technical Report B-94-1, HITLab, University of Washington, USA, 2001.
[11]
A. X. Falçao and J. K. Udupa. A 3D generalization of user-steered live-wire segmentation. Medical Image Analysis, 4:389--402, 2000.
[12]
J. L. Foo. A survey of user interaction and automation in medical image segmentation methods. Technical Report ISU-HCI-2006-2, Iowa State Universtity - Human Computer Interaction, 2006.
[13]
H. K. Hahn, B. Preim, D. Selle, and H. O. Peitgen. Visualization and interaction techniques for the exploration of vascular structures. In Proc. of IEEE Visualization 2001, pages 395--402.
[14]
M. Harders, S. Wildermuth, and G. Székely. New paradigms for interactive 3D volume segmentation. Visualization and Computer Animation, 13: 85--95, 2002.
[15]
T. Heiman, M. Kunert, and H.-P. Meinzer. New methods for leak detection and contour correction in seeded region growing segmentation. In International Archives of Photogrammetry and Remote Sensing, volume XXXV, 2004.
[16]
G. Hesina, D. Schmalstieg, A. Fuhrmann, and W. Purgathofer. Distributed Open Inventor: a practical approach to distributed 3D graphics. In Proc. of VRST '99, pages 74--81.
[17]
H. Hoppe. Optimization of mesh locality for transparent vertex caching. In Proc. of SIGGRAPH '99, pages 269--276.
[18]
H. Hoppe. Progressive meshes. Computer Graphics, 30(Annual Conference Series):99--108, 1996.
[19]
M. Jackowski, A. Goshtasby, and M. Satter. Interactive tools for image segmentation. In In. Proc. of SPIE '99, volume 3661.
[20]
Y. Kang, K. Engelke, and W. A. Kalender. Interactive 3D editing tools for image segmentation. Medical Image Analysis, 8:35--46, 2004.
[21]
P. Kry, D. James, and D. Pai. Eigenskin: Real time large eformation character skinning in hardware. In Proc. of SIGGRAPH '02.
[22]
H. Lamecker, T. Lange, and M. Seeba. A statistical shape model for the liver. In Proc. of MICCAI 2002, pages 422--427.
[23]
A. E. Lefohn, J. E. Cates, and R. T. Whitaker. Interactive, GPU-based level sets for 3D segmentation. In Proc. of MICCAI '03.
[24]
H.-P. Meinzer, P. Schemmer, and et al. Computer-based surgery planning for living liver donation. In International Archives of Photogrammetry and Remote Sensing, volume XXXV, pages 291--295, 2004.
[25]
J. Montagnat, H. Delingette, and N. Ayache. A review of deformable surfaces: topology, geometry and deformation. Image and Vision Computing, 19(14):1023--1040.
[26]
B. S. Morse, T. S. Yoo, and et al. Interpolating implicit surfaces from scattered surface data using compactly supported radial basis functions. In Proc. of SMI '01, pages 89--98.
[27]
M. Nienhaus and J. Döllner. Blueprints: illustrating architecture and technical parts using hardware-accelerated non-photorealistic rendering. In Proc. of GI '04, pages 49--56.
[28]
M. Nienhaus and J. Döllner. Sketchy drawings: a hardware-accelerated approach for real-time non-photorealistic rendering. In Proc. of SIGGRAPH '03.
[29]
B. Reitinger, A. Bornik, and R. Beichel. Efficient volume measurement using voxelization. In Proc. of SCCG '03, pages 47--54.
[30]
S. Senger. Visualizing and segmenting large volumetric data sets. IEEE Computer Graphics and Applications, pages 32--37, 1999.
[31]
A. Sharf, T. Lewiner, A. Shamir, L. Kobbelt, and D. Cohen-Or. Competing fronts for coarse-to-fine surface reconstruction. In Proc. of Eurographics 2006, volume 25. in print.
[32]
J. A. Sethian. Level Set Methods and Fast Marching Methods. Cambridge University Press, 1999.
[33]
L. Soler, H. Delingette, and et al. Fully automatic anatomical, pathological, and functional segmentation from CT scans for hepatic surgery. Computer Aided Surgery, 6(3): 131--42.
[34]
J. Teran, E. Sifakis, G. Irving, and R. Fedkiw. Robust quasistatic finite elements and flesh simulation. ACM Transaction on Graphics, 2005.
[35]
D. Terzopoulos, J. Platt, and et al. Elastically deformable models. In Proc. of SIGGRAPH '87, pages 205--214.
[36]
I. Wolf, M. Hasenteufel, and et al. ROPES: a semiautomated segmentation method for accelerated analysis of three-dimensional echocardiographic data. IEEE Transactions on Medical Imaging, 21(9): 1091--1104, 2002.

Cited By

View all
  • (2016)FISICO: Fast Image SegmentatIon COrrectionPLOS ONE10.1371/journal.pone.015603511:5(e0156035)Online publication date: 25-May-2016
  • (2013)Sketch‐Based Editing Tools for Tumour Segmentation in 3D Medical ImagesComputer Graphics Forum10.1111/cgf.1219332:8(144-157)Online publication date: 13-Aug-2013
  • (2012)Force feedback to assist active contour modelling for tracheal stenosis segmentationAdvances in Human-Computer Interaction10.1155/2012/6324982012(5-5)Online publication date: 1-Jan-2012
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VRST '06: Proceedings of the ACM symposium on Virtual reality software and technology
November 2006
400 pages
ISBN:1595933212
DOI:10.1145/1180495
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2006

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 3D user interfaces
  2. hybrid user interfaces
  3. interactive segmentation
  4. segmentation refinement
  5. virtual reality

Qualifiers

  • Article

Conference

VRST06

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)23
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2016)FISICO: Fast Image SegmentatIon COrrectionPLOS ONE10.1371/journal.pone.015603511:5(e0156035)Online publication date: 25-May-2016
  • (2013)Sketch‐Based Editing Tools for Tumour Segmentation in 3D Medical ImagesComputer Graphics Forum10.1111/cgf.1219332:8(144-157)Online publication date: 13-Aug-2013
  • (2012)Force feedback to assist active contour modelling for tracheal stenosis segmentationAdvances in Human-Computer Interaction10.1155/2012/6324982012(5-5)Online publication date: 1-Jan-2012
  • (2009)Comparison and Evaluation of Methods for Liver Segmentation From CT DatasetsIEEE Transactions on Medical Imaging10.1109/TMI.2009.201385128:8(1251-1265)Online publication date: Aug-2009

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media