research-article

Data-Driven Analysis of Virtual 3D Exploration of a Large Sculpture Collection in Real-World Museum Exhibitions

Authors:

Markus Hadwiger,

Enrico GobbettiAuthors Info & Claims

Journal on Computing and Cultural Heritage (JOCCH), Volume 11, Issue 1

Article No.: 2, Pages 1 - 20

https://doi.org/10.1145/3099618

Published: 12 December 2017 Publication History

Abstract

We analyze use of an interactive system for the exploration of highly detailed three-dimensional (3D) models of a collection of protostoric Mediterranean sculptures. In this system, when the object of interest is selected, its detailed 3D model and associated information are presented at high resolution on a large display controlled by a touch-enabled horizontal surface at a suitable distance. The user interface combines an object-aware interactive camera controller with an interactive point-of-interest selector and is implemented within a scalable implementation based on multiresolution structures shared between the rendering and user interaction subsystems. The system was installed in several temporary and permanent exhibitions and was extensively used by tens of thousands of visitors. We provide a data-driven analysis of usage experience based on logs gathered during a 27-month period at four exhibitions in archeological museums for a total of more than 75K exploration sessions. We focus on discerning the main visitor behaviors during 3D exploration by employing tools for deriving interest measures on surfaces and tools for clustering and knowledge discovery from high-dimensional data. The results highlight the main trends in visitor behavior during the interactive sessions. These results provide useful insights for the design of 3D exploration user interfaces in future digital installations.

References

[1]

Marco Agus, Fabio Marton, Fabio Bettio, and Enrico Gobbetti. 2016. Interactive 3D exploration of a virtual sculpture collection: An analysis of user behavior in museum setting. In Proceedings of the 13th Eurographics Worhshop on Graphics and Cultural Heritage.

Digital Library

[2]

C. Andujar, A. Chica, and P. Brunet. 2012. Cultural heritage: User-interface design for the ripoll monastery exhibition at the national art museum of catalonia. Comput. Graph. 36, 1 (2012), 28--37.

Digital Library

[3]

Marcos Balsa Rodriguez, Marco Agus, Fabio Bettio, Fabio Marton, and Enrico Gobbetti. 2015. Digital mont’e prama: 3D cultural heritage presentations in museums and anywhere. In Proceedings of the International Conference on Digital Heritage. 545--552.

[4]

Marcos Balsa Rodriguez, Marco Agus, Fabio Bettio, Fabio Marton, and Enrico Gobbetti. 2016. Digital mont’e prama: Exploring large collections of detailed 3D models of sculptures. (submitted).

[5]

Marcos Balsa Rodriguez, Marco Agus, Fabio Marton, and Enrico Gobbetti. 2014. HuMoRS: Huge models mobile rendering system. In Proceedings of the ACM Web3D International Symposium. 7--16.

Digital Library

[6]

Marcos Balsa Rodriguez, Marco Agus, Fabio Marton, and Enrico Gobbetti. 2015. Adaptive recommendations for enhanced non-linear exploration of annotated 3D objects. Comput. Graph. Forum 34, 3 (2015), 41--50.

Digital Library

[7]

Marcos Balsa Rodriguez, Enrico Gobbetti, Fabio Marton, and Alex Tinti. 2013. Compression-domain seamless multiresolution visualization of gigantic meshes on mobile devices. In Proceedings of the ACM International Conference on Web3D. 99--107.

Digital Library

[8]

Fabio Bettio, Enrico Gobbetti, Emilio Merella, and Ruggero Pintus. 2013. Improving the digitization of shape and color of 3D artworks in a cluttered environment. In Proceedings of the International Conference on Digital Heritage. 23--30.

[9]

Fabio Bettio, Alberto Jaspe, Emilio Merella, Fabio Marton, Enrico Gobbetti, and Ruggero Pintus. 2015. Mont’e scan: Effective shape and color digitization of cluttered 3D artworks. J. Comut. Cult. Herit. 8, 1 (2015), 4:1--4:23.

Digital Library

[10]

Silvia Biasotti, Andrea Cerri, Bianca Falcidieno, and Michela Spagnuolo. 2015. 3D artifacts similarity based on the concurrent evaluation of heterogeneous properties. J. Comput. Cult. Herit. 8, 4, Article 19 (Aug. 2015), 19 pages.

Digital Library

[11]

Tamy Boubekeur. 2014. ShellCam: Interactive geometry-aware virtual camera control. In Proceedings of the International Conference on Image Processing (ICIP’14). 4003--4007.

[12]

Umberto Castellani, Marco Cristani, Simone Fantoni, and Vittorio Murino. 2008. Sparse points matching by combining 3D mesh saliency with statistical descriptors. In Computer Graphics Forum, Vol. 27. Wiley Online Library, 643--652.

[13]

Paolo Cignoni, Fabio Ganovelli, Enrico Gobbetti, Fabio Marton, Federico Ponchio, and Roberto Scopigno. 2004. Adaptive tetrapuzzles: Efficient out-of-core construction and visualization of gigantic multiresolution polygonal models. ACM Trans. Graph. 23, 3 (2004), 796--803.

Digital Library

[14]

Dane Coffey, Nicholas Malbraaten, Trung Bao Le, Iman Borazjani, Fotis Sotiropoulos, Arthur G. Erdman, and Daniel F. Keefe. 2012. Interactive slice WIM: Navigating and interrogating volume data sets using a multisurface, multitouch VR interface. IEEE Trans. Vis. Comput. Graph. 18, 10 (2012), 1614--1626.

Digital Library

[15]

Livio De Luca. 2014. Methods, formalisms and tools for the semantic-based surveying and representation of architectural heritage. Appl. Geom. 6, 2 (2014), 115--139.

[16]

Paul Debevec. 2005. Making “The parthenon.” In Proceedings of the IEEE Conference on Visual Analytics Science and Technology (VAST’05).

[17]

Vincenzo Deufemia, Luca Paolino, Genoveffa Tortora, A. Traverso, Viviana Mascardi, Massimo Ancona, Maurizio Martelli, Nicoletta Bianchi, and Henry De Lumley. 2012. Investigative analysis across documents and drawings: Visual analytics for archaeologists. In Proceedings of the International Working Conference on Advanced Visual Interfaces. ACM, 539--546.

Digital Library

[18]

Marco Di Benedetto, Fabio Ganovelli, Marcos Balsa Rodriguez, Alberto Jaspe Villanueva, Roberto Scopigno, and Enrico Gobbetti. 2014. ExploreMaps: Efficient construction and ubiquitous exploration of panoramic view graphs of complex 3D environments. Comput. Graph. Forum 33, 2 (2014), 459--468.

Digital Library

[19]

Helin Dutagaci, Chun Pan Cheung, and Afzal Godil. 2012. Evaluation of 3D interest point detection techniques via human-generated ground truth. Vis. Comput. 28, 9 (2012), 901--917.

Digital Library

[20]

Martin Ester, Hans-Peter Kriegel, Jörg Sander, and Xiaowei Xu. 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’96), Vol. 96. 226--231.

Digital Library

[21]

H. J. Falk and L. D. Dierking. 2000. Learning from Museums: Visitor Experience and the Making of Meaning. Rowman & Littlefield.

[22]

N. Gelfand, N. J. Mitra, L. J. Guibas, and H. Pottmann. 2005. Robust global registration. In Proceedings of the Symposium on Geometry Processing. 197--206.

Digital Library

[23]

Mark Harrower and Cynthia A. Brewer. 2011. ColorBrewer. org: an online tool for selecting colour schemes for maps. The Map Reader: Theories of Mapping Practice and Cartographic Representation (2011), 261--268.

[24]

Jiaxi Hu and Jing Hua. 2009. Salient spectral geometric features for shape matching and retrieval. Vis. Comput. 25, 5--7 (2009), 667--675.

Digital Library

[25]

Anil K. Jain. 2010. Data clustering: 50 years beyond K-means. Pattern Recogn. Lett. 31, 8 (2010), 651--666.

Digital Library

[26]

Piotr Jankowski, Natalia Andrienko, Gennady Andrienko, and Slava Kisilevich. 2010. Discovering landmark preferences and movement patterns from photo postings. Trans. GIS 14, 6 (2010), 833--852.

[27]

Takeshi Kurashima, Tomoharu Iwata, Go Irie, and Ko Fujimura. 2010. Travel route recommendation using geotags in photo sharing sites. In Proceedings of the 19th ACM International Conference on Information and Knowledge Management. ACM, 579--588.

Digital Library

[28]

Chang Ha Lee, Amitabh Varshney, and David W. Jacobs. 2005. Mesh saliency. ACM Transactions on Graphics (TOG), 24, 3 (2005), 659--666.

Digital Library

[29]

Max Limper, Arjan Kuijper, and Dieter W. Fellner. 2016. Mesh saliency analysis via local curvature entropy. In Proceedings of the 37th Annual Conference of the European Association for Computer Graphics: Short Papers. Eurographics Association, 13--16.

Digital Library

[30]

Shusen Liu, Dan Maljovec, Bei Wang, Peer-Timo Bremer, and Valerio Pascucci. 2015. Visualizing high-dimensional data: Advances in the past decade. In Proceedings of the Eurographics Conference on Visualization. 127--147.

[31]

Luigi Malomo, Paolo Cignoni, and Roberto Scopigno. 2016. Generalized trackball for surfing over surfaces. In STAG: Smart Tools and Apps for Graphics. Eurographics.

Digital Library

[32]

Fabio Marton, Marco Agus, Enrico Gobbetti, Giovanni Pintore, and Marcos Balsa Rodriguez. 2012. Natural exploration of 3D massive models on large-scale light field displays using the FOX proximal navigation technique. Comput. Graph. 36, 8 (Dec. 2012), 893--903.

Digital Library

[33]

Fabio Marton, Marcos Balsa Rodriguez, Fabio Bettio, Marco Agus, Alberto Jaspe, and Enrico Gobbetti. 2014. IsoCam: Interactive visual exploration of massive cultural heritage models on large projection setups. J. Comput. Cult. Herit. 7, 2 (2014), Article 12.

Digital Library

[34]

Robert E. Patterson, Leslie M. Blaha, Georges G. Grinstein, Kristen K. Liggett, David E. Kaveney, Kathleen C. Sheldon, Paul R. Havig, and Jason A. Moore. 2014. A human cognition framework for information visualization. Comput. Graph. 42 (2014), 42--58.

[35]

Marco Potenziani, Marco Callieri, Matteo Dellepiane, Massimiliano Corsini, Federico Ponchio, and Roberto Scopigno. 2015. 3DHOP: 3D heritage online presenter. Comput. Graph. 52 (2015), 129--141.

Digital Library

[36]

Kun Qian, Jizhou Sun, Hui Chen, and Jiawan Zhang. 2016. Visual analysis method for cultural heritage site risk assessment. Journal of Visualization 19, 3 (2016), 503--514.

Digital Library

[37]

Ivan Sipiran and Benjamin Bustos. 2011. Harris 3D: A robust extension of the harris operator for interest point detection on 3D meshes. Vis. Comput. 27, 11 (2011), 963--976.

Digital Library

[38]

Ran Song, Yonghuai Liu, Ralph R. Martin, and Paul L. Rosin. 2014. Mesh saliency via spectral processing. ACM Trans. Graph. 33, 1 (2014), 6.

Digital Library

[39]

Jian Sun, Maks Ovsjanikov, and Leonidas Guibas. 2009. A concise and provably informative multi-scale signature based on heat diffusion. In Computer Graphics Forum, Vol. 28. Wiley Online Library, 1383--1392.

Digital Library

[40]

Alessandro Torrisi, Giovanni Signorello, Giovanni Gallo, M. De Salvo, and Giovanni Maria Farinella. 2015. Mining social images to analyze routing preferences in tourist areas. In Workshop on Visualisation in Environmental Sciences (EnvirVis).

[41]

Daniel R. Trindade and Alberto B. Raposo. 2011. Improving 3D navigation in multiscale environments using cubemap-based techniques. In Proceedings of the ACM Annual Symposium on Applied Computing (SAC’11). 1215--1221.

Digital Library

[42]

Carlo Tronchetti and Peter Van Dommelen. 2005. Entangled objects and hybrid practices: Colonial contacts and elite connections at monte prama, sardinia. J. Med. Arch. 18, 2 (2005), 183.

[43]

Romain Vergne, Romain Pacanowski, Pascal Barla, Xavier Granier, and Christophe Schlick. 2010. Radiance scaling for versatile surface enhancement. In Proceedings of the 2010 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games. ACM, 143--150.

Digital Library

[44]

N. Walter, O. Aubreton, and O. Laligant. 2008. Salient point characterization for low resolution meshes. In Proceedings of the 15th IEEE International Conference on Image Processing. 1512--1515.

[45]

Malte Weiss, Simon Voelker, Christine Sutter, and Jan Borchers. 2010. BendDesk: Dragging across the curve. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS10). 1--10.

Digital Library

[46]

Raphael Wimmer, Fabian Hennecke, Florian Schulz, Sebastian Boring, Andreas Butz, and Heinrich Hussmann. 2010. Curve: Revisiting the digital desk. In Proceedings of the Nordic Forum for Human-Computer Interaction (NordiCHI’10). 561--570.

Digital Library

[47]

Jiawan Zhang, Kai Kang, Dajian Liu, Ye Yuan, and E. Yanli. 2013. Vis4heritage: Visual analytics approach on grotto wall painting degradations. IEEE Trans. Vis. Comput. Graph. 19, 12 (2013), 1982--1991.

Digital Library

Cited By

Liu S(2024)Innovative design of digital sculpture art under 3D modeling technologyApplied Mathematics and Nonlinear Sciences10.2478/amns-2024-15259:1Online publication date: 2-Jul-2024
https://doi.org/10.2478/amns-2024-1525
Basu APaul SGhosh SDas SChanda BBhagvati CSnasel V(2023)Digital Restoration of Cultural Heritage With Data-Driven Computing: A SurveyIEEE Access10.1109/ACCESS.2023.328063911(53939-53977)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3280639
Apollonio FGaiani MGaragnani S(2022)Visualization and Fruition of Cultural Heritage in the Knowledge-Intensive SocietyHandbook of Research on Implementing Digital Reality and Interactive Technologies to Achieve Society 5.010.4018/978-1-6684-4854-0.ch020(471-495)Online publication date: 30-Jun-2022
https://doi.org/10.4018/978-1-6684-4854-0.ch020
Show More Cited By

Index Terms

Data-Driven Analysis of Virtual 3D Exploration of a Large Sculpture Collection in Real-World Museum Exhibitions
1. Applied computing
  1. Document management and text processing
    1. Document capture
      1. Graphics recognition and interpretation
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics
    1. Animation

Recommendations

Visiting virtual reality museum exhibits
JCDL '04: Proceedings of the 4th ACM/IEEE-CS joint conference on Digital libraries

Virtual museums provide ways to capture the content of a real museum in a digital (electronic) form and make this digital form more universally available. This exhibit demonstrates a novel method for digitally recording entire museum exhibits and ...
Virtual exhibitions: what do we win and what do we lose?
EVA '18: Proceedings of the Conference on Electronic Visualisation and the Arts

Virtual reality (VR) promises to allow for replicating the physical world. As consequence, it is used in the context of digital curating to enable remote exhibition visits. In this paper, we are exploring what visitors win and what they lose in virtual ...
Virtual Museum ‘Takeouts’ and DIY Exhibitions–Augmented Reality Apps for Scholarship, Citizen Science and Public Engagement
Digital Heritage. Progress in Cultural Heritage: Documentation, Preservation, and Protection
Abstract
This paper presents an Augmented Reality (AR) project for the curation of virtual museum ‘takeouts’ and DIY exhibitions. The project’s outputs include novel AR app technology demonstrators to support co-design with museum users and stakeholders - ...

Comments

Information & Contributors

Information

Published In

cover image Journal on Computing and Cultural Heritage

Journal on Computing and Cultural Heritage Volume 11, Issue 1

Special Issue on GCH 2016 and Regular Papers

January 2018

116 pages

ISSN:1556-4673

EISSN:1556-4711

DOI:10.1145/3172938

Editor:
Roberto Scopigno
CNRźISTI, Italy

Issue’s Table of Contents

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 December 2017

Accepted: 01 May 2017

Revised: 01 April 2017

Received: 01 January 2017

Published in JOCCH Volume 11, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Soprintendenza Archeologia della Sardegna
Sardinian Regional Authorities
King Abdullah University of Science and Technology

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
397
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)3

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Liu S(2024)Innovative design of digital sculpture art under 3D modeling technologyApplied Mathematics and Nonlinear Sciences10.2478/amns-2024-15259:1Online publication date: 2-Jul-2024
https://doi.org/10.2478/amns-2024-1525
Basu APaul SGhosh SDas SChanda BBhagvati CSnasel V(2023)Digital Restoration of Cultural Heritage With Data-Driven Computing: A SurveyIEEE Access10.1109/ACCESS.2023.328063911(53939-53977)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3280639
Apollonio FGaiani MGaragnani S(2022)Visualization and Fruition of Cultural Heritage in the Knowledge-Intensive SocietyHandbook of Research on Implementing Digital Reality and Interactive Technologies to Achieve Society 5.010.4018/978-1-6684-4854-0.ch020(471-495)Online publication date: 30-Jun-2022
https://doi.org/10.4018/978-1-6684-4854-0.ch020
Garagnani SD’Ugo RLupi AMartini BSalvucci MSusta MTombolato MBarsanti R(2022)Visual Perception and Cognition by the Means of Interactive Digital Replicas of Museum Artifacts: Leonardo da Vinci’s Drawings as If They Were in Visitors’ HandsHeritage10.3390/heritage60100016:1(1-25)Online publication date: 20-Dec-2022
https://doi.org/10.3390/heritage6010001
Apollonio FFantini FGaragnani SGaiani M(2021)A Photogrammetry-Based Workflow for the Accurate 3D Construction and Visualization of Museums AssetsRemote Sensing10.3390/rs1303048613:3(486)Online publication date: 30-Jan-2021
https://doi.org/10.3390/rs13030486
Zhang JLiu SFan JHuang JPei M(2020)NK-CDS: A Creative Design System for Museum Art DerivativesIEEE Access10.1109/ACCESS.2020.29725618(29259-29269)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.2972561
Calì CAgus MGagnon NHadwiger MMagistretti PStanco FGiachetti APingi P(2017)Visual analysis of glycogen derived lactate absorption in dense and sparse surface reconstructions of rodent brain structuresProceedings of the Conference on Smart Tools and Applications in Computer Graphics10.2312/stag.20171224(31-38)Online publication date: 11-Sep-2017
https://dl.acm.org/doi/10.2312/stag.20171224

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents