Article

An innovative three-dimensional user interface for exploring music collections enriched

Authors:

Gerhard WidmerAuthors Info & Claims

MM '06: Proceedings of the 14th ACM international conference on Multimedia

Pages 17 - 24

https://doi.org/10.1145/1180639.1180652

Published: 23 October 2006 Publication History

Abstract

We present a novel, innovative user interface to music repositories. Given an arbitrary collection of digital music files, our system creates a virtual landscape which allows the user to freely navigate in this collection. This is accomplished by automatically extracting features from the audio signal and training a Self-Organizing Map (SOM) on them to form clusters of similar sounding pieces of music. Subsequently, a Smoothed Data Histogram (SDH) is calculated on the SOM and interpreted as a three-dimensional height profile. This height profile is visualized as a three-dimensional island landscape containing the pieces of music. While moving through the terrain, the closest sounds with respect to the listener's current position can be heard. This is realized by anisotropic auralization using a 5.1 surround sound model. Additionally, we incorporate knowledge extracted automatically from the web to enrich the landscape with semantic information. More precisely, we display words and related images that describe the heard music on the landscape to support the exploration.

References

[1]

M. Allen, J. Gluck, K. MacLean, and E. Tang. An initial usability assessment for symbolic haptic rendering of music parameters. In ICMI '05: Proc. of the 7th international conference on Multimodal interfaces, New York, NY, USA, 2005. ACM Press.

Digital Library

[2]

J.-J. Aucouturier, F. Pachet, and M. Sandler. "The Way It Sounds": Timbre Models for Analysis and Retrieval of Music Signals. IEEE Transactions on Multimedia, 7(6):1028--1035, December 2005.

Digital Library

[3]

E. Brazil and M. Fernström. Audio information browsing with the sonic browser. In Coordinated and Multiple Views In Exploratory Visualization (CMV03), London, UK, 2003.

Digital Library

[4]

P. Cano, M. Kaltenbrunner, F. Gouyon, and E. Batlle. On the Use of Fastmap for Audio Retrieval and Browsing. In Proc. of the International Conference on Music Information Retrieval (ISMIR'02), Paris, France, 2002.

[5]

M. Goto and T. Goto. Musicream: New Music Playback Interface for Streaming, Sticking, and Recalling Musical Pieces. In Proc. of the 6th International Conference on Music Information Retrieval (ISMIR'05), London, UK, 2005.

[6]

P. Knees, E. Pampalk, and G. Widmer. Artist Classification with Web-based Data. In Proc. of 5th International Conference on Music Information Retrieval (ISMIR'04), Barcelona, Spain, October 2004.

[7]

T. Kohonen. Self-Organizing Maps, volume 30 of Springer Series in Information Sciences. Springer, Berlin, 3rd edition, 2001.

Digital Library

[8]

K. Lagus and S. Kaski. Keyword selection method for characterizing text document maps. In Proc. of 9th International Conference on Artificial Neural Networks (ICANN'99), volume 1, London, 1999. IEEE.

[9]

D. Lübbers. Sonixplorer: Combining Visualization and Auralization for Content-based Exploration of Music Collections. In Proc. of the 6th International Conference on Music Information Retrieval (ISMIR'05), London, UK, 2005.

[10]

M. Mandel and D. Ellis. Song-Level Features and Support Vector Machines for Music Classification. In Proc. of the 6th International Conference on Music Information Retrieval (ISMIR'05), London, UK, 2005.

[11]

F. Mörchen, A. Ultsch, M. Nöcker, and C. Stamm. Databionic visualization of music collections according to perceptual distance. In Proc. of the 6th International Conference on Music Information Retrieval (ISMIR'05), London, UK, 2005.

[12]

R. Neumayer, M. Dittenbach, and A. Rauber. PlaySOM and PocketSOMPlayer, Alternative Interfaces to Large Music Collections. In Proc. of the 6th International Conference on Music Information Retrieval (ISMIR'05), London, UK, 2005.

[13]

E. Pampalk. Islands of Music: Analysis, Organization, and Visualization of Music Archives. Master's thesis, Vienna University of Technology, 2001.

[14]

E. Pampalk, S. Dixon, and G. Widmer. Exploring music collections by browsing different views. Computer Music Journal, 28(2):49--62, 2004.

Digital Library

[15]

E. Pampalk, A. Flexer, and G. Widmer. Hierarchical organization and description of music collections at the artist level. In Proc. of the 9th European Conference on Research and Advanced Technology for Digital Libraries (ECDL'05), Vienna, Austria, 2005.

Digital Library

[16]

E. Pampalk, A. Rauber, and D. Merkl. Content-based organization and visualization of music archives. In Proc. of the ACM Multimedia, Juan les Pins, France, December 1-6 2002. ACM.

Digital Library

[17]

E. Pampalk, A. Rauber, and D. Merkl. Using smoothed data histograms for cluster visualization in self-organizing maps. In Proc. of the International Conference on Artifical Neural Networks (ICANN'02), Madrid, Spain, 2002.

Digital Library

[18]

S. Pauws, D. Bouwhuis, and B. Eggen. Programming and enjoying music with your eyes closed. In CHI '00: Proc. of the SIGCHI conference on Human factors in computing systems, New York, NY, USA, 2000. ACM Press.

Digital Library

[19]

M. Schedl. An explorative, hierarchical user interface to structured music repositories. Master's thesis, Vienna University of Technology, December 2003.

[20]

I. Stavness, J. Gluck, L. Vilhan, and S. Fels. The MUSICtable: A Map-Based Ubiquitous System for Social Interaction with a Digital Music Collection. In Proc. of the 4th International Conference on Entertainment Computing (ICEC 2005), Sanda, Japan, 2005.

Digital Library

[21]

M. Torrens, P. Hertzog, and J.-L. Arcos. Visualizing and Exploring Personal Music Libraries. In Proc. of 5th International Conference on Music Information Retrieval (ISMIR'04), Barcelona, Spain, 2004.

[22]

G. Tzanetakis and P. Cook. Marsyas3D: A Prototype Audio Browser-Editor Using a Large Scale Immersive Visual Audio Display. In Proc. of the International Conference on Auditory Display, 2001.

[23]

R. van Gulik, F. Vignoli, and H. van de Wetering. Mapping music in the palm of your hand, explore and discover your collection. In Proc. of 5th International Conference on Music Information Retrieval (ISMIR'04), Barcelona, Spain, 2004.

[24]

B. Whitman and S. Lawrence. Inferring descriptions and similarity for music from community metadata. In Proc. of the 2002 International Computer Music Conference, Goteborg, Sweden, September 2002.

[25]

J. A. Wise, J. J. Thomas, K. Pennock, D. Lantrip, M. Pottier, A. Schur, and V. Crow. Visualizing the Non-Visual: Spatial analysis and interaction with information from text documents. In Proc. of the 1995 IEEE Symposium on Information Visualization (INFOVIS'95), Atlanta, Georgia, 1995.

Digital Library

[26]

Y. Yang and J. O. Pedersen. A comparative study on feature selection in text categorization. In D. H. Fisher, editor, Proc. of ICML-97, 14th International Conference on Machine Learning, Nashville, US, 1997.

Digital Library

Cited By

Gabbolini GBridge D(2024)Surveying More Than Two Decades of Music Information Retrieval Research on PlaylistsACM Transactions on Intelligent Systems and Technology10.1145/368839815:6(1-68)Online publication date: 12-Aug-2024
https://dl.acm.org/doi/10.1145/3688398
Tsukuda KTakahashi TIshida KHamasaki MGoto M(2024)Kiite World: Socializing Map-Based Music Exploration Through Playlist Sharing and Synchronized ListeningMultiMedia Modeling10.1007/978-981-96-2061-6_15(197-211)Online publication date: 31-Dec-2024
https://doi.org/10.1007/978-981-96-2061-6_15
Ziegler JLoepp B(2024)Interactive Recommendation SystemsHandbook of Human Computer Interaction10.1007/978-3-319-27648-9_54-1(1-29)Online publication date: 11-Feb-2024
https://doi.org/10.1007/978-3-319-27648-9_54-1
Show More Cited By

Index Terms

An innovative three-dimensional user interface for exploring music collections enriched
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

A survey of music similarity and recommendation from music context data

In this survey article, we give an overview of methods for music similarity estimation and music recommendation based on music context data. Unlike approaches that rely on music content and have been researched for almost two decades, music-context-...
Exploring Music Collections in Virtual Landscapes

A user interface to music repositories called nepTune creates a virtual landscape for an arbitrary collection of digital music files, letting users freely navigate the collection. Automatically extracting features from the audio signal and clustering ...
Music similarity and retrieval
SIGIR '13: Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval

This tutorial serves as an introductory course to the field of and state-of-the-art in music information retrieval (MIR) and in particular to music similarity estimation which is an essential component of music retrieval. Apart from explaining ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '06: Proceedings of the 14th ACM international conference on Multimedia

October 2006

1072 pages

ISBN:1595934472

DOI:10.1145/1180639

General Chairs:
Klara Nahrstedt
UIUC
,
Matthew Turk
UCSB
,
Program Chairs:
Yong Rui
Microsoft Research
,
Wolfgang Klas
Universität Wien
,
Ketan Mayer-Patel
UNC

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM06

Sponsor:

MM06: The 14th ACM International Conference on Multimedia 2006

October 23 - 27, 2006

CA, Santa Barbara, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

59
Total Citations
View Citations
1,183
Total Downloads

Downloads (Last 12 months)37
Downloads (Last 6 weeks)3

Reflects downloads up to 18 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gabbolini GBridge D(2024)Surveying More Than Two Decades of Music Information Retrieval Research on PlaylistsACM Transactions on Intelligent Systems and Technology10.1145/368839815:6(1-68)Online publication date: 12-Aug-2024
https://dl.acm.org/doi/10.1145/3688398
Tsukuda KTakahashi TIshida KHamasaki MGoto M(2024)Kiite World: Socializing Map-Based Music Exploration Through Playlist Sharing and Synchronized ListeningMultiMedia Modeling10.1007/978-981-96-2061-6_15(197-211)Online publication date: 31-Dec-2024
https://doi.org/10.1007/978-981-96-2061-6_15
Ziegler JLoepp B(2024)Interactive Recommendation SystemsHandbook of Human Computer Interaction10.1007/978-3-319-27648-9_54-1(1-29)Online publication date: 11-Feb-2024
https://doi.org/10.1007/978-3-319-27648-9_54-1
Velenis KKaliakatsos-Papakostas MPasias LCambouropoulos E(2023)Visualisations of Jazz Standards Derived from Transformer-based Multi-task LearningProceedings of the 27th Pan-Hellenic Conference on Progress in Computing and Informatics10.1145/3635059.3635072(79-87)Online publication date: 24-Nov-2023
https://dl.acm.org/doi/10.1145/3635059.3635072
Tang YChang CYang XIgarashi T(2023)SyncLabeling: A Synchronized Audio Segmentation Interface for Mobile DevicesProceedings of the ACM on Human-Computer Interaction10.1145/36042737:MHCI(1-19)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604273
Kunkel JZiegler J(2023)A comparative study of item space visualizations for recommender systemsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102987172:COnline publication date: 9-Mar-2023
https://dl.acm.org/doi/10.1016/j.ijhcs.2022.102987
Schedl MMayr MKnees PGurrin CÞór Jónsson BKando NSchoeffmann KChen PO'Connor N(2020)Music Tower Blocks: Multi-Faceted Exploration Interface for Web-Scale Music AccessProceedings of the 2020 International Conference on Multimedia Retrieval10.1145/3372278.3391928(388-392)Online publication date: 8-Jun-2020
https://dl.acm.org/doi/10.1145/3372278.3391928
Khulusi RKusnick JMeinecke CGillmann CFocht JJänicke S(2020)A Survey on Visualizations for Musical DataComputer Graphics Forum10.1111/cgf.1390539:6(82-110)Online publication date: 5-Mar-2020
https://doi.org/10.1111/cgf.13905
Casaña-Eslava RJarman IOrtega-Martorell SLisboa PMartín-Guerrero J(2020)Music genre profiling based on Fisher manifolds and Probabilistic Quantum ClusteringNeural Computing and Applications10.1007/s00521-020-05499-xOnline publication date: 12-Nov-2020
https://doi.org/10.1007/s00521-020-05499-x
Collares LTavares TGooch ATzanetakis G(2018)Personalizing self-organizing music spaces with anchorsMultimedia Tools and Applications10.1007/s11042-017-4465-877:5(5525-5545)Online publication date: 1-Mar-2018
https://dl.acm.org/doi/10.1007/s11042-017-4465-8
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten