A music search engine built upon audio-based and web-based similarity measures

ABSTRACT

An approach is presented to automatically build a search engine for large-scale music collections that can be queried through natural language. While existing approaches depend on explicit manual annotations and meta-data assigned to the individual audio pieces, we automatically derive descriptions by making use of methods from Web Retrieval and Music Information Retrieval. Based on the ID3 tags of a collection of mp3 files, we retrieve relevant Web pages via Google queries and use the contents of these pages to characterize the music pieces and represent them by term vectors. By incorporating complementary information about acous tic similarity we are able to both reduce the dimensionality of the vector space and improve the performance of retrieval, i.e. the quality of the results. Furthermore, the usage of audio similarity allows us to also characterize audio pieces when there is no associated information found on the Web.

REFERENCES

• 1: J.-J. Aucouturier. Ten Experiments on the Modelling of Polyphonic Timbre. PhD thesis, University of Paris 6, 2006.
• 2: J.-J. Aucouturier and F. Pachet. Music Similarity Measures: What's the Use? In Proceedings of the 3rd International Conference on Music Information Retrieval, Paris, France, 2002.
• 3: J.-J. Aucouturier, F. Pachet, and M. Sandler. "The Way It Sounds": Timbre Models for Analysis and Retrieval of Music Signals . IEEE Transactions on Multimedia, 7(6):1028--1035, December 2005.
• 4: Ricardo A. Baeza-Yates , Berthier Ribeiro-Neto, Modern Information Retrieval, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 5: S. Baumann, A. Klüter, and M. Norlien. Using natural language input and audio analysis for a human-oriented mir system. In Proceedings of the 2nd International Conference on Web Delivering of Music, Darmstadt, Germany, 2002.
• 6: Pedro Cano , Markus Koppenberger , Nicolas Wack, An industrial-strength content-based music recommendation system, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076185]
• 7: I. Celino, E. Della Valle, D. Cerizza, and A. Turati. Squiggle: a semantic search engine for indexing and retrieval of multimedia content. In Proceedings of the1st International Workshop on Semantic-enhanced Multimedia Presentation Systems, Athens, Greece, 2006.
• 8: O. Celma, P. Cano, and P. Herrera. Search Sounds: An audio crawler focused on weblogs. In Proceedings of the 7th International Conference on Music Information Retrieval, Victoria, B.C., Canada, 2006.
• 9: O. Celma, M. Ramirez, and P. Herrera. Foafing the music: A music recommendation system based on RSS feeds and user preferences. In Proceedings of the 6th International Conference on Music Information Retrieval, London, UK, 2005.
• 10: Paolo Ciaccia , Marco Patella , Pavel Zezula, M-tree: An Efficient Access Method for Similarity Search in Metric Spaces, Proceedings of the 23rd International Conference on Very Large Data Bases, p.426-435, August 25-29, 1997
• 11: Asif Ghias , Jonathan Logan , David Chamberlin , Brian C. Smith, Query by humming: musical information retrieval in an audio database, Proceedings of the third ACM international conference on Multimedia, p.231-236, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215273]
• 12: M. Goto and T. Goto. Musicream: New Music Playback Interface for Streaming, Sticking, and Recalling Musical Pieces. In Proceedings of the 6th International Conference on Music Information Retrieval, London, UK, 2005.
• 13: Thomas Hofmann, Probabilistic latent semantic indexing, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.50-57, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312649]
• 14: P. Knees, E. Pampalk, and G. Widmer. Artist Classification with Web-based Data. In Proceedings of 5th International Conference on Music Information Retrieval, Barcelona, Spain, 2004.
• 15: Peter Knees , Markus Schedl , Tim Pohle , Gerhard Widmer, An innovative three-dimensional user interface for exploring music collections enriched, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180652]
• 16: I. Knopke. Aroooga: An audio search engine for the world wide web. In Proceedings of the International Computer Music Conference, Miami, USA, 2004.
• 17: Namunu C. Maddage , Haizhou Li , Mohan S. Kankanhalli, Music structure based vector space retrieval, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148185]
• 18: M. Mandel and D. Ellis. Song-Level Features and Support Vector Machines for Music Classification. In Proceedings of the 6th International Conference on Music Information Retrieval, London, UK, 2005.
• 19: F. Pachet and D. Cazaly. A Taxonomy of Musical Genres. In Proceedings of RIAO 2000 Content-Based Multimedia Information Access, Paris, France, 2000.
• 20: E. Pampalk. Computational Models of Music Similarity and their Application to Music Information Retrieval. PhD thesis, Vienna University of Technology, March 2006.
• 21: E. Pampalk and M. Goto. Musicrainbow: A new user interface to discover artists using audio-based similarity and web-based labeling. In Proceedings of the 7th International Conference on Music Information Retrieval, Victoria, B.C., Canada, 2006.
• 22: T. Pohle, P. Knees, M. Schedl, and G. Widmer. Automatically Adapting the Structure of Audio Similarity Spaces. In Proceedings of the 1st Workshop on Learning the Semantics of Audio Signals, Athens, Greece, 2006.
• 23: Gerard Salton , Christopher Buckley, Term-weighting approaches in automatic text retrieval, Information Processing and Management: an International Journal, v.24 n.5, p.513-523, 1988 [doi>10.1016/0306-4573(88)90021-0 ]
• 24: Brian A. Whitman , Barry L. Vercoe, Learning the meaning of music, Massachusetts Institute of Technology, Cambridge, MA, 2005
• 25: B. Whitman and S. Lawrence. Inferring Descriptions and Similarity for Music from Community Metadata. In Proceedings of the 2002 International Computer Music Conference, Gothenburg, Sweden, 2002.
• 26: Yiming Yang , Jan O. Pedersen, A Comparative Study on Feature Selection in Text Categorization, Proceedings of the Fourteenth International Conference on Machine Learning, p.412-420, July 08-12, 1997

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.5 Sound and Music Computing

General Terms:
Algorithms

Keywords:
context-based retrieval, cross-media retrieval, music information retrieval, music search engine, music similarity