skip to main content
10.1145/1101149.1101278acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

MusicStory: a personalized music video creator

Published: 06 November 2005 Publication History

Abstract

In this paper, we describe MusicStory, a system that automatically creates videos to accompany music with lyrics. MusicStory uses common search engines, photo-sharing websites, and simple analysis of the dynamics and tempo of the music to create personalized photo-narratives. Video pacing and content is based on the content of the song and structure of the image repositories selected. The image associations MusicStory presents amplify the emotional experience by externalizing the imagery in song lyrics with the content found within a social network. The resulting work juxtaposes the meanings inherent in the social network with those in the song.

References

[1]
J. Budzik. Information Access in Context: Experiences with the Watson System. PhD thesis, Northwestern University, June 2003.
[2]
M. Cooper and J. Foote. Summarizing popular music via structural similarity analysis. In 2003 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, October 2003.
[3]
M. Csikszentmihalyi. Flow: The Psychology of Optimal Experience. Harper & Row, New York, NY, USA, 1990.
[4]
X. S. Hua, L. Lu, and H. J. Zhang. P-karaoke: personalized karaoke system. In MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on Multimedia, pages 172-173, New York, NY, USA, 2004. ACM Press.
[5]
W. Kandinksy. Point and line to plane: A contribution to the analysis of pictoral elements. In K. C. Lindsay and P. Vergo, editors, Complete Writings on Art, pages 528-699. Da Capo Press, USA, first edition, 1994 edition, 1926.
[6]
M. Mellody, M. A. Bartsch, and G. H. Wakefield. Analysis of vowels in sung queries for a music information retrieval system. Journal of Intelligent Information Systems, 21(1):35--52, 2003.
[7]
M. Mirapaul. Art unfolds in a search for keywords. The New York Times, page E5, 17 June 2004. Vol. CLIII, No. 52883, Circuits Section.
[8]
B. Pardo. Tempo tracking with a single oscillator. In ISMIR 2004, 5th International Conference on Music Information Retrieval, Barcelona, Spain, October 10-14 2004.
[9]
A. Pikrakis, I. Antonopoulos, and S. Theodoridis. Music meter & tempo tracking from audio. In ISMIR 2004, 5th International Conference on Music Information Retrieval, Barcelona, Spain, October 10-14 2004.
[10]
M. Ruberry, S. Owsley, D. A. Shamma, J. Budzik, and C. Albrecht-Buehler. Affective behaviors for theatrical agents. In IUI 2005 Workshop on Affective Interactions: The Computer in the Affective Loop, San Diego, CA USA, January 2005.
[11]
D. A. Shamma. Network Arts: Defining Emotional Interaction in Media Arts and Information Retrieval. PhD thesis, Northwestern University, Evanston, IL, USA, December 2005. (in prepairation).
[12]
D. A. Shamma and K. J. Hammond. Imagination environment: Using the web as a source of popular culture. In ACM SIGGRAPH 2004 Emerging Technology track. ACM Press, 2004.
[13]
D. A. Shamma, S. Owsley, S. Bradshaw, and K. J. Hammond. Using web frequency within multi-media exhibitions. In Proceedings of the 12th International Conference on Multi-Media. ACM Press, 2004.
[14]
D. A. Shamma, S. Owsley, K. J. Hammond, S. Bradshaw, and J. Budzik. Network Arts: Exposing cultural reality. In Alternate track papers & posters of the 13th international conference on World Wide Web, pages 41--47. ACM Press, 2004.
[15]
The Simpsons. DVD, 2002. Creator, director and producers notes from the season commentary.
[16]
Nextfest.2005. Wired Magazine, 13(6):24, June 2005. The Wired World's Fair, June 24-26, Chicago. Insert Booklet.

Cited By

View all
  • (2021)DEMV-matchmaker: Emotional temporal course representation and deep similarity matching for automatic music video generation2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP.2016.7472182(2772-2776)Online publication date: 11-Mar-2021
  • (2017)Modeling the timing of cuts in automatic editing of concert videosMultimedia Tools and Applications10.1007/s11042-016-3304-776:5(6683-6707)Online publication date: 1-Mar-2017
  • (2008)Automatic Generation of Music Slide Show Using Personal PhotosProceedings of the 2008 Tenth IEEE International Symposium on Multimedia10.1109/ISM.2008.39(214-219)Online publication date: 15-Dec-2008
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MULTIMEDIA '05: Proceedings of the 13th annual ACM international conference on Multimedia
November 2005
1110 pages
ISBN:1595930442
DOI:10.1145/1101149
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2005

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. media arts
  2. music video
  3. network arts
  4. photo sharing
  5. software agents
  6. world wide web

Qualifiers

  • Article

Conference

MM05

Acceptance Rates

MULTIMEDIA '05 Paper Acceptance Rate 49 of 312 submissions, 16%;
Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)18
  • Downloads (Last 6 weeks)0
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2021)DEMV-matchmaker: Emotional temporal course representation and deep similarity matching for automatic music video generation2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP.2016.7472182(2772-2776)Online publication date: 11-Mar-2021
  • (2017)Modeling the timing of cuts in automatic editing of concert videosMultimedia Tools and Applications10.1007/s11042-016-3304-776:5(6683-6707)Online publication date: 1-Mar-2017
  • (2008)Automatic Generation of Music Slide Show Using Personal PhotosProceedings of the 2008 Tenth IEEE International Symposium on Multimedia10.1109/ISM.2008.39(214-219)Online publication date: 15-Dec-2008
  • (2007)Retrieving Web Images to Enrich Music RepresentationMultimedia and Expo, 2007 IEEE International Conference on10.1109/ICME.2007.4284635(256-259)Online publication date: Jul-2007
  • (2007)Automated Music Video Generation using WEB Image Resource2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '0710.1109/ICASSP.2007.366341(II-737-II-740)Online publication date: Apr-2007

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media