skip to main content
research-article

IsoCam: Interactive Visual Exploration of Massive Cultural Heritage Models on Large Projection Setups

Published: 01 June 2014 Publication History

Abstract

We introduce a novel user interface and system for exploring extremely detailed 3D models in a museum setting. Three-dimensional models and associated information are presented on a large projection surface controlled by a touch-enabled surface placed at a suitable distance in front of it. Our indirect user interface, dubbed IsoCam, combines an object-aware interactive camera controller with an interactive point-of-interest selector and is implemented within a scalable implementation based on multiresolution structures shared between the rendering and user interaction subsystems. The collision-free camera controller automatically supports the smooth transition from orbiting to proximal navigation, by exploiting a distance-field representation of the 3D object. The point-of-interest selector exploits a specialized view similarity computation to propose a few nearby easily reachable interesting 3D views from a large database, move the camera to the user-selected point of interest, and provide extra information through overlaid annotations of the target view. The capabilities of our approach have been demonstrated in a public event attended by thousands of people, which were offered the possibility to explore submillimetric reconstructions of 38 stone statues of the Mont’e Prama Nuragic complex, depicting larger-than-life human figures, and small models of prehistoric Nuraghe (cone-shaped stone towers). A follow-up of this work, using 2.5m-high projection screens, is now included in permanent exhibitions at two Archeological Museums. Results of a thorough user evaluation, involving quantitative and subjective measurements, are discussed.

Supplementary Material

marton (marton.zip)
Supplemental movie and image files for, IsoCam: Interactive Visual Exploration of Massive Cultural Heritage Models on Large Projection Setups

References

[1]
C. Andujar, A. Chica, and P. Brunet. 2012. Cultural heritage: User-interface design for the Ripoll monastery exhibition at the National Art Museum of Catalonia. Computers and Graphics 36, 1 (2012), 28--37.
[2]
Marcos Balsa Rodriguez, Enrico Gobbetti, Fabio Marton, and Alex Tinti. 2013. Compression-domain seamless multiresolution visualization of gigantic meshes on mobile devices. In Proc. ACM Web3D. ACM, 99--107.
[3]
Isaac Besora, Pere Brunet, Marco Callieri, Antoni Chica, Massimiliano Corsini, Matteo Dellepiane, Daniel Morales, Jordi Moyés, Guido Ranzuglia, and Roberto Scopigno. 2008. Portalada: A virtual reconstruction of the entrance of the Ripoll monastery. In Proc. 3DPVT. 89--96.
[4]
Fabio Bettio, Enrico Gobbetti, Fabio Marton, Alex Tinti, Emilio Merella, and Roberto Combet. 2009. A point-based system for local and remote exploration of dense 3D scanned models. In Proc. the 10th International Symposium on Virtual Reality, Archaeology and Cultural Heritage. 25--32.
[5]
Fabio Bettio, Enrico Gobbetti, Emilio Merella, and Ruggero Pintus. 2013. Improving the digitization of shape and color of 3D artworks in a cluttered environment. In Proc. Digital Heritage. To appear.
[6]
Fabio Bettio, Alberto Jaspe Villanueva, Emilio Merella, Ruggero Pintus, Fabio Marton, and Enrico Gobbetti. 2014. Mont’e scan: Effective shape and color digitization of cluttered 3D artworks. Submittted for publication (2014).
[7]
Doug A. Bowman, Chris North, Jian Chen, Nicholas F. Polys, Pardha S. Pyla, and Umur Yilmaz. 2003. Information-rich virtual environments: Theory, tools, and research agenda. In Proc. ACM VRST. ACM, 81--90.
[8]
Nicholas Burtnyk, Azam Khan, George Fitzmaurice, Ravin Balakrishnan, and Gordon Kurtenbach. 2002. StyleCam: Interactive stylized 3D navigation using integrated spatial and temporal controls. In Proc. ACM UIST. ACM, 101--110.
[9]
Nicolas Burtnyk, Azam Khan, George Fitzmaurice, and Gordon Kurtenbach. 2006. ShowMotion: Camera motion based 3D design review. In Proc. ACM I3D. ACM, 167--174.
[10]
T. Butkiewicz and C. Ware. 2011. Multi-touch 3D exploratory analysis of ocean flow models. In Proc. IEEE Oceans. IEEE.
[11]
Marco Callieri, Chiara Leoni, Matteo Dellepiane, and Roberto Scopigno. 2013. Artworks narrating a story: A modular framework for the integrated presentation of three-dimensional and textual contents. In Proc. ACM Web3D. ACM, 167--175.
[12]
Marco Callieri, Federico Ponchio, Paolo Cignoni, and Roberto Scopigno. 2008. Virtual inspector: A flexible visualizer for dense 3D scanned models. IEEE Computer Graphics and Applications 28, 1 (2008), 44--54.
[13]
Michael Chen, S. Joy Mountford, and Abigail Sellen. 1988. A study in interactive 3-D rotation using 2-D control devices. In Proc. SIGGRAPH. ACM, 121--129.
[14]
Marc Christie and Patrick Olivier. 2009. Camera control in computer graphics: models, techniques and applications. In ACM SIGGRAPH ASIA Courses. ACM, 3:1--3:197.
[15]
Paolo Cignoni, Fabio Ganovelli, Enrico Gobbetti, Fabio Marton, Federico Ponchio, and Roberto Scopigno. 2004. Adaptive tetrapuzzles: Efficient out-of-core construction and visualization of gigantic multiresolution polygonal models. ACM Transactions on Graphics 23, 3 (2004), 796--803.
[16]
Dane Coffey, Nicholas Malbraaten, Trung Bao Le, Iman Borazjani, Fotis Sotiropoulos, Arthur G. Erdman, and Daniel F. Keefe. 2012. Interactive slice WIM: Navigating and interrogating volume data sets using a multisurface, multitouch VR interface. IEEE Transactions on Visualization and Computer Graphics 18, 10 (2012), 1614--1626.
[17]
Michel Crampes, Jeremy de Oliveira-Kumar, Sylvie Ranwez, and Jean Villerd. 2009. Visualizing social photos on a Hasse diagram for eliciting relations and indexing new photos. IEEE Transactions on Visualization and Computer Graphics 15, 6 (Nov. 2009), 985--992.
[18]
Jean-Baptiste de la Rivière, Cédric Kervégant, Emmanuel Orvain, and Nicolas Dittlo. 2008. CubTile: A multi-touch cubic interface. In Proc. ACM VRST. ACM, 69--72.
[19]
Andreas Dietrich, Enrico Gobbetti, and Sung-eui Yoon. 2007. Massive-model rendering techniques: A tutorial. IEEE Computer Graphics and Applications 27, 6 (Nov./Dec. 2007), 20--34.
[20]
Boris Epshtein, Eyal Ofek, Yonatan Wexler, and Pusheng Zhang. 2007. Hierarchical photo organization using geo-relevance. In Proc. ACM GIS. ACM, 18:1--18:7.
[21]
H. J. Falk and L. D. Dierking. 2000. Learning from Museums: Visitor Experience and the Making of Meaning. Rowman & Littlefield.
[22]
Peter Faraday and Alistair Sutcliffe. 1997. Designing effective multimedia presentations. In Proc. ACM SIGCHI. ACM, 272--278.
[23]
George Fitzmaurice, Justin Matejka, Igor Mordatch, Azam Khan, and Gordon Kurtenbach. 2008. Safe 3D navigation. In Proc. ACM I3D. ACM, 7--15.
[24]
Alessandro E. Foni, George Papagiannakis, and Nadia Magnenat-Thalmann. 2010. A taxonomy of visualization strategies for cultural heritage applications. Journal on Computing and Cultural Heritage 3, 1 (July 2010), 1:1--1:21.
[25]
Chi-Wing Fu, Wooi-Boon Goh, and Junxiang Allen Ng. 2010. Multi-touch techniques for exploring large-scale 3D astrophysical simulations. In Proc. ACM SIGCHI. ACM, 2213--2222.
[26]
Andreas Girgensohn, Frank Shipman, Lynn Wilcox, Thea Turner, and Matthew Cooper. 2009. MediaGLOW: Organizing photos in a graph-based workspace. In Proc. ACM IUI. ACM, 419--424.
[27]
Enrico Gobbetti, David Kasik, and Sung-eui Yoon. 2008. Technical strategies for massive model visualization. In Proc. ACM Solid and Physical Modeling Symposium. ACM, 405--415.
[28]
Timo Götzelmann, Pere-Pau Vázquez, Knut Hartmann, Andreas Nürnberger, and Thomas Strothotte. 2007. Correlating text and images: Concept and evaluation. In Proc. Smart Graphics. Springer-Verlag, Berlin, 97--109.
[29]
Martin Hachet, Jean-Baptiste de la Rivière, Jrmy Laviole, Aurlie Coh, and Sbastien Cursan. 2013. Touch-based interfaces for interacting with 3D content in public exhibitions. IEEE Computer Graphics and Applications 33, 2 (March 2013), 80--85.
[30]
Mark Hancock, Sheelagh Carpendale, and Andy Cockburn. 2007. Shallow-depth 3D interaction: Design and evaluation of one-, two- and three-touch techniques. In Proc. ACM SIGCHI. ACM, 1147--1156.
[31]
Mark Hancock, Otmar Hilliges, Christopher Collins, Dominikus Baur, and Sheelagh Carpendale. 2009. Exploring tangible and direct touch interfaces for manipulating 2D and 3D information on a digital table. In Proc. ITS. ACM, 77--84.
[32]
Andrew J. Hanson and Eric A. Wernert. 1997. Constrained 3D navigation with 2D controllers. In Proc. IEEE Visualization. IEEE, 175--182.
[33]
Knud Henriksen, Jon Sporring, and Kasper Hornbæk. 2004. Virtual trackballs revisited. IEEE Transactions on Visualization and Computer Graphics 10, 2 (March 2004), 206--216.
[34]
Chuljin Jang, Taijin Yoon, and Hwan-Gue Cho. 2009. A smart clustering algorithm for photo set obtained from multiple digital cameras. In Proc. ACM SAC. ACM, 1784--1791.
[35]
Jacek Jankowski and Stefan Decker. 2012. A dual-mode user interface for accessing 3D content on the world wide web. In Proc. WWW. ACM, 1047--1056.
[36]
Jacek Jankowski and Martin Hachet. 2013. A survey of interaction techniques for interactive 3D environments. In Eurographics STAR.
[37]
Jacek Jankowski, Krystian Samp, Izabela Irzynska, Marek Jozwowicz, and Stefan Decker. 2010. Integrating text with video and 3D graphics: The effects of text drawing styles on text readability. In Proc. ACM SIGCHI. ACM, 1321--1330.
[38]
D. F. Keefe and T. Isenberg. 2013. Reimagining the scientific visualization interaction paradigm. Computer 46, 5 (May 2013), 51--57.
[39]
Azam Khan, Ben Komalo, Jos Stam, George Fitzmaurice, and Gordon Kurtenbach. 2005. HoverCam: Interactive 3D navigation for proximal object inspection. In Proc. I3D. ACM, 73--80.
[40]
Tijmen Klein, Florimond Guéniat, Luc Pastur, Frédéric Vernier, and Tobias Isenberg. 2012. A design study of direct-touch interaction for exploratory 3D scientific visualization. Computer Graphics Forum 31 (2012), 1225--1234.
[41]
Sebastian Knoedel and Martin Hachet. 2011. Multi-touch RST in 2D and 3D spaces: Studying the impact of directness on user performance. In Proc. ACM 3DUI. ACM, 75--78.
[42]
Tsvi Kuflik, Oliviero Stock, Massimo Zancanaro, Ariel Gorfinkel, Sadek Jbara, Shahar Kats, Julia Sheidin, and Nadav Kashtan. 2011. A visitor’s guide in an active museum: Presentations, communications, and reflection. Journal on Computing and Cultural Heritage 3, 3, Article 11 (2011), 11:1--11:25 pages.
[43]
Gordon Kurtenbach, George Fitzmaurice, Thomas Baudel, and Bill Buxton. 1997. The design of a GUI paradigm based on tablets, two-hands, and transparency. In Proc. ACM SIGCHI. ACM, 35--42.
[44]
Christian Lauterbach, Sung-Eui Yoon, and Dinesh Manocha. 2007. Ray-Strips: A compact mesh representation for interactive ray tracing. In Proc. IEEE/EG Symposium on Interactive Ray Tracing. IEEE, 19--26.
[45]
Claes Lundstrom, Thomas Rydell, Camilla Forsell, Anders Persson, and Anders Ynnerman. 2011. Multi-touch table system for medical visualization: Application to orthopedic surgery planning. IEEE Transactions on Visualization and Computer Graphics 17, 12 (Dec. 2011), 1775--1784.
[46]
Anthony Martinet, Géry Casiez, and Laurent Grisoni. 2009. 3D positioning techniques for multi-touch displays. In Proc. ACM VRST. ACM, 227--228.
[47]
Anthony Martinet, Gery Casiez, and Laurent Grisoni. 2012. Integrality and separability of multitouch interaction techniques in 3D manipulation tasks. IEEE Transactions on Visualization and Computer Graphics 18, 3 (March 2012), 369--380.
[48]
Fabio Marton, Marco Agus, Enrico Gobbetti, Giovanni Pintore, and Marcos Balsa Rodriguez. 2012. Natural exploration of 3D massive models on large-scale light field displays using the FOX proximal navigation technique. Computers & Graphics 36, 8 (December 2012), 893--903.
[49]
James McCrae, Igor Mordatch, Michael Glueck, and Azam Khan. 2009. Multiscale 3D navigation. In Proc. I3D. ACM, 7--14.
[50]
Clement Moerman, Damien Marchal, and Laurent Grisoni. 2012. Drag’n Go: Simple and fast navigation in virtual environment. In Proc 3DUI. IEEE, 15--18.
[51]
Tomer Moscovich and John F. Hughes. 2008. Indirect mappings of multi-touch input using one and two hands. In Proc. ACM SIGCHI. ACM, 1275--1284.
[52]
João Mota, Manuel J. Fonseca, Daniel Gonçalves, and Joaquim A. Jorge. 2008. Agrafo: A visual interface for grouping and browsing digital photos. In Proc. ACM AVI. ACM, 494--495.
[53]
Giovanni Pintore, Enrico Gobbetti, Fabio Ganovelli, and Paolo Brivio. 2012. 3DNSITE: A networked interactive 3D visualization system to simplify location recognition in crisis management. In Proc. ACM Web3D. ACM, 59--67.
[54]
Nicholas F. Polys, Doug A. Bowman, and Chris North. 2011. The role of depth and gestalt cues in information-rich virtual environments. International Journal of Human-Computer Studies 69, 1--2 (Jan. 2011), 30--51.
[55]
R Core Team. 2013. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria.
[56]
Jason L. Reisman, Philip L. Davidson, and Jefferson Y. Han. 2009. A screen-space formulation for 2D and 3D direct manipulation. In Proc. ACM UIST. ACM, 69--78.
[57]
Dong-Sung Ryu, Woo-Keun Chung, and Hwan-Gue Cho. 2010. PHOTOLAND: A new image layout system using spatio-temporal information in digital photos. In Proc. ACM SAC. ACM, 1884--1891.
[58]
Ken Shoemake. 1992. ARCBALL: A user interface for specifying three-dimensional orientation using a mouse. In Proc. SIGGRAPH. Morgan Kaufmann, San Francisco, CA, 151--156.
[59]
Henry Sonnet, Sheelagh Carpendale, and Thomas Strothotte. 2005. Integration of 3D data and text: The effects of text positioning, connectivity, and visual hints on comprehension. In Human-Computer Interaction (INTERACT’05), Maria Francesca Costabile and Fabio Patern (Eds.). Lecture Notes in Computer Science, Vol. 3585. Springer, Berlin, 615--628.
[60]
Malte Weiss, Simon Voelker, Christine Sutter, and Jan Borchers. 2010. BendDesk: Dragging across the curve. In Proc. ACM International Conference on Interactive Tabletops and Surfaces. ACM, 1--10.
[61]
Raphael Wimmer, Fabian Hennecke, Florian Schulz, Sebastian Boring, Andreas Butz, and Heinrich Hussmann. 2010. Curve: Revisiting the digital desk. In Proc, NordiCHI. ACM, 561--570.
[62]
Sung-eui Yoon, Enrico Gobbetti, David Kasik, and Dinesh Manoc ha. 2008. Real-time Massive Model Rendering. Synthesis Lectures on Computer Graphics and Animation, Vol. 2. Morgan and Claypool.
[63]
Lingyun Yu, Pjotr Svetachov, Petra Isenberg, Maarten H. Everts, and Tobias Isenberg. 2010. FI3D: Direct-touch interaction for the exploration of 3D scientific visualization spaces. IEEE Transactions on Visualization and Computer Graphics 16, 6 (Nov. 2010), 1613--1622.
[64]
Robert Zeleznik and Andrew Forsberg. 1999. UniCam: 2D gestural camera controls for 3D environments. In Proc. Symposium on Interactive 3D Graphics. ACM, 169--173.

Cited By

View all
  • (2024)MemoVis: A GenAI-Powered Tool for Creating Companion Reference Images for 3D Design FeedbackACM Transactions on Computer-Human Interaction10.1145/369468131:5(1-41)Online publication date: 4-Sep-2024
  • (2024)RelicCARD: Enhancing cultural relics exploration through semantics-based augmented reality tangible interaction designVisual Informatics10.1016/j.visinf.2024.06.0038:3(32-41)Online publication date: Sep-2024
  • (2023)Interactive Occlusion-Free System for Accessible Volume ExplorationIEEE Access10.1109/ACCESS.2023.330156711(86544-86560)Online publication date: 2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Journal on Computing and Cultural Heritage
Journal on Computing and Cultural Heritage   Volume 7, Issue 2
Special Issue on Interacting with the Past
July 2014
160 pages
ISSN:1556-4673
EISSN:1556-4711
DOI:10.1145/2635823
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 2014
Accepted: 01 March 2014
Revised: 01 February 2014
Received: 01 July 2013
Published in JOCCH Volume 7, Issue 2

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 3D navigation
  2. 3D viewers
  3. 3D visualization
  4. Interaction techniques
  5. camera controls

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)26
  • Downloads (Last 6 weeks)5
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)MemoVis: A GenAI-Powered Tool for Creating Companion Reference Images for 3D Design FeedbackACM Transactions on Computer-Human Interaction10.1145/369468131:5(1-41)Online publication date: 4-Sep-2024
  • (2024)RelicCARD: Enhancing cultural relics exploration through semantics-based augmented reality tangible interaction designVisual Informatics10.1016/j.visinf.2024.06.0038:3(32-41)Online publication date: Sep-2024
  • (2023)Interactive Occlusion-Free System for Accessible Volume ExplorationIEEE Access10.1109/ACCESS.2023.330156711(86544-86560)Online publication date: 2023
  • (2022)ARtefact: A Conceptual Framework for the Integrated Information Management of Archaeological ExcavationsExtended Reality10.1007/978-3-031-15553-6_16(211-223)Online publication date: 6-Jul-2022
  • (2021)Hands-On Deformation of Volumetric Anatomical Images on a TouchscreenApplied Sciences10.3390/app1120950211:20(9502)Online publication date: 13-Oct-2021
  • (2021)A UWB-Driven Self-Actuated Projector Platform for Interactive Augmented Reality ApplicationsApplied Sciences10.3390/app1106287111:6(2871)Online publication date: 23-Mar-2021
  • (2021)3D Visual Interaction for Cultural Heritage SectorData Analytics for Cultural Heritage10.1007/978-3-030-66777-1_9(195-232)Online publication date: 26-Mar-2021
  • (2020)Methods and Practices for Assessing the User Experience of Interactive Systems for Cultural HeritageApplying Innovative Technologies in Heritage Science10.4018/978-1-7998-2871-6.ch009(171-208)Online publication date: 2020
  • (2020)Empirical Evaluations of Interactive Systems in Cultural HeritageCognitive Analytics10.4018/978-1-7998-2460-2.ch067(1331-1355)Online publication date: 2020
  • (2020)An application independent review of multimodal 3D registration methodsComputers & Graphics10.1016/j.cag.2020.07.01291(153-178)Online publication date: Oct-2020
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media