skip to main content
10.1145/1385569.1385651acmconferencesArticle/Chapter ViewAbstractPublication PagesaviConference Proceedingsconference-collections
poster

Toward a natural interface to virtual medical imaging environments

Published: 28 May 2008 Publication History

Abstract

Immersive Virtual Reality environments are suitable to support activities related to medicine and medical practice. The immersive visualization of information-rich 3D objects, coming from patient scanned data, provides clinicians with a clear perception of depth and shapes. However, to benefit from immersive visualization in medical imaging, where inspection and manipulation of volumetric data are fundamental tasks, medical experts have to be able to act in the virtual environment by exploiting their real life abilities. In order to reach this goal, it is necessary to take into account user skills and needs so as to design and implement usable and accessible human-computer interaction interfaces. In this paper we present a natural interface for a semi-immersive virtual environment. Such interface is based on an off-the-shelf handheld wireless device and a speech recognition component, and provides clinicians with intuitive interaction modes for inspecting volumetric medical data.

References

[1]
Salgado, R., Mulkens, T., Bellinck, P. and Termote, J. L., "Volume rendering in clinical practice. A pictorial review", JBR-BTR, 86(4): 215--20 (2003).
[2]
Robb, R. A. "The Biomedical Imaging Resource at Mayo Clinic", IEEE Trans. Med. Imaging, 20(9): 854--867 (2001).
[3]
Wu, Y. and Yencharis, L. "Commercial 3-D Imaging Software Migrates to PC Medical Diagnostics", Advanced Imaging Magazine, 16--21 (1998).
[4]
Rosset, A., Spadola, L., Ratib, O. 2004. OsiriX: a new generation of multidimensional DICOM viewer based on new imaging standards. In Proceedings of the 18th International Congress and Exhibition of Computer Assisted Radiology and Surgery (Chicago, USA, June 23--26, 2004). CARS 2004.
[5]
Narayan, M., Waugh, L., Zhang, X., Bafna, P. and Bowman, D. 2005. Quantifying the benefits of immersion for collaboration in virtual environments. In Proceedings of the ACM symposium on Virtual reality software and technology (Monterey, California, USA, November 07--09, 2005). VRST 2005.
[6]
Bowman, D. A., Chen, J., Wrave, C. A, Lucas, J., Ray, A., Polys, N. F., Li, Q., Haciahmetoglu, Y., Kim, J. S., Kim, S., Boehringer, R. and Ni, T., "New Directions in 3D User Interfaces", The International Journal of Virtual Reality, 5(2): 3--14 (2006).
[7]
Nintendo Wii, http://it.wii.com/
[8]
Coronato, A., De Pietro, G., and Marra, I. 2006. An Open-Source Software Architecture for Immersive Medical Imaging. In Proceedings of the IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems (La Coruna, Spain, July 10--12, 2006). VECIMS 2006.
[9]
WiiLi, a GNU/Linux port for the Nintendo Wii, http://www.wiili.org
[10]
WiiBrew Wiki, http://wiibrew.org/index.php?title=Wiimote
[11]
Dech, F. and Silverstein, J. C. 2002. Rigorous Exploration of Medical Data in Collaborative Virtual Reality Applications. In Proceedings of the International Conference on Information Visualisation (London, UK, July 10--12, 2002). IV 2002.
[12]
Gallo, L., De Pietro, G. and Marra, I. 2008. 3D Interaction with Volumetric Medical Data: experiencing the Wiimote. To appear in Proceedings of the First International Conference on Ambient Media and Systems (Quebec City, Canada, February 4--7, 2008). Ambi-sys 2008.
[13]
Sphinx-III speech recognition system, http://cmusphinx.sourceforge.net/html/cmusphinx.php

Cited By

View all
  • (2021)Hands-free interaction in immersive virtual reality: A systematic reviewIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.306768727:5(2702-2713)Online publication date: May-2021
  • (2020)BreastScreeningProceedings of the 2020 International Conference on Advanced Visual Interfaces10.1145/3399715.3399744(1-5)Online publication date: 28-Sep-2020
  • (2019)Use of Commercial Off-The-Shelf Devices for the Detection of Manual Gestures in Surgery: Systematic Literature ReviewJournal of Medical Internet Research10.2196/1192521:5(e11925)Online publication date: 3-May-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
AVI '08: Proceedings of the working conference on Advanced visual interfaces
May 2008
483 pages
ISBN:9781605581415
DOI:10.1145/1385569
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 May 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 3D interaction
  2. 3D user interface
  3. VTK
  4. medical imaging
  5. virtual reality
  6. wireless

Qualifiers

  • Poster

Conference

AVI '08
Sponsor:

Acceptance Rates

Overall Acceptance Rate 128 of 490 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)5
  • Downloads (Last 6 weeks)0
Reflects downloads up to 27 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2021)Hands-free interaction in immersive virtual reality: A systematic reviewIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.306768727:5(2702-2713)Online publication date: May-2021
  • (2020)BreastScreeningProceedings of the 2020 International Conference on Advanced Visual Interfaces10.1145/3399715.3399744(1-5)Online publication date: 28-Sep-2020
  • (2019)Use of Commercial Off-The-Shelf Devices for the Detection of Manual Gestures in Surgery: Systematic Literature ReviewJournal of Medical Internet Research10.2196/1192521:5(e11925)Online publication date: 3-May-2019
  • (2016)Intuitive Exploration of Volumetric Data Using Dynamic GalleriesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2015.246729422:1(896-905)Online publication date: 31-Jan-2016
  • (2016)Three-Dimensional Display Technologies for Anatomical Education: A Literature ReviewJournal of Science Education and Technology10.1007/s10956-016-9619-325:4(641-654)Online publication date: 19-Apr-2016
  • (2014)Virtual neurosurgical education for image-guided deep brain stimulation neurosurgery2014 International Conference on Audio, Language and Image Processing10.1109/ICALIP.2014.7009869(623-626)Online publication date: Jul-2014
  • (2014)An event-based notification approach for the delivery of patient medical informationInformation Systems10.1016/j.is.2013.07.00239(22-44)Online publication date: 1-Jan-2014
  • (2014)Retrieval of high-dimensional visual dataMultimedia Tools and Applications10.1007/s11042-012-1327-269:2(539-567)Online publication date: 1-Mar-2014
  • (2012)Architectural Models for Reliable Multi-User InterfacesUser Interface Design for Virtual Environments10.4018/978-1-61350-516-8.ch005(76-91)Online publication date: 2012
  • (2012)An infrastructure for smart hospitalsMultimedia Tools and Applications10.1007/s11042-010-0695-859:1(341-362)Online publication date: 1-Jul-2012
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media