skip to main content
10.1145/2986416.2986444acmotherconferencesArticle/Chapter ViewAbstractPublication PagesamConference Proceedingsconference-collections
research-article

^muzicode$: Composing and Performing Musical Codes

Published: 04 October 2016 Publication History

Abstract

We present muzicodes, an approach to incorporating machine-readable 'codes' into music that allows the performer and/or composer to flexibly define what constitutes a code, and to perform around it. These codes can then act as triggers, for example to control an accompaniment or visuals during a performance. The codes can form an integral part of the music (composition and/or performance), and may be more or less obviously present. This creates a rich space of playful interaction with a system that recognises and responds to the codes. Our proof of concept implementation works with audio or MIDI as input. Muzicodes are represented textually and regular expressions are used to flexibly define them. We present two contrasting demonstration applications and summarise the findings from two workshops with potential users which highlight opportunities and challenges, especially in relation to specifying and matching codes and playing and performing with the system.

References

[1]
A. Shenton. 2008. Olivier Messiaen's system of signs: notes towards understanding his music. Ashgate Publishing, Ltd.
[2]
J. Wingstedt, S. Brändström, and J. Berg. 2010. Narrative music, visuals and meaning in film. Vis. Commun. 9, 2, 193-- 210.
[3]
E. Sams. 1970. Elgar's Cipher Letter to Dorabella. Music. Times, 151--154.
[4]
Perle, George. 1972. Serial composition and atonality: an introduction to the music of Schoenberg, Berg, and Webern. Univ of California Press.
[5]
Chirp. http://www.chirp.io/ verified 2016-01-21.
[6]
J. S. Downie. 2003. Music information retrieval. Annu. Rev. Inf. Sci. Technol. 37, 1, 295--34.
[7]
O. Lartillot and P. Toiviainen. 2007. A Matlab toolbox for musical feature extraction from audio, In International Conference on Digital Audio Effects, 237--244.
[8]
C. Cannam, M. Mauch, M. E. Davies, S. Dixon, C. Landone, K. Noland, M. Levy, M. Zanoni, D. Stowell, and L. A. Figueira, 2013. MIREX 2013 entry: Vamp plugins from the centre for digital music. MIREX.
[9]
E. Benetos and S. Dixon. 2012. A Shift-Invariant Latent Variable Model for Automatic Music Transcription. Comput. Music J. 36, 4 (Dec.2012), 81--94.
[10]
J. Salamon, E. Gomez, D. P. Ellis, and G. Richard. 2014. Melody extraction from polyphonic music signals: Approaches, applications, and challenges. Signal Process. Mag. IEEE 31, 2--134.
[11]
A. Wang. 2006. The Shazam music recognition service. Commun. ACM 49, 8, 44--48.
[12]
A. Jordanous and A. Smaill. 2009. Investigating the Role of Score Following in Automatic Musical Accompaniment. J. New Music Res. 38, 2 (June 2009), 197--209.
[13]
C. Joder, S. Essid, and G. Richard. 2011. A Conditional Random Field Framework for Robust and Scalable Audio-to-Score Matching. IEEE Trans. Audio Speech Lang. Process. 19, 8 (Nov. 2011), 2385--2397.
[14]
R. Rowe. 1992. Machine Listening and Composing with Cypher. Comput. Music J. 16, 1, 43.
[15]
A. M. Stark. 2014. Sound Analyser: A Plug-In For Real-Time Audio Analysis In Live Performances And Installations. In Proceedings of New Interfaces for Musical Expression (NIME), London, 2014.
[16]
John E. Hopcroft, Rajeev Motwani and Jeffrey D. Ullman. 2013. Introduction to Automata Theory, Languages, and Computation (3rd ed.). Pearson. ISBN:1292039051.
[17]
Steve Benford, Peter Tolmie, Ahmed Ahmed, Andy Crabtree, Tom Rodden. 2012. Supporting traditional music-making: designing for situated discretion. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work (CSCW '12). ACM, New York, NY, USA, 127--136.
[18]
ABC Notation, http://abcnotation.com verified 2016-05-20

Cited By

View all
  • (2020)Following the journey of scores through a complex musical workProceedings of the 15th International Conference on Audio Mostly10.1145/3411109.3411116(249-252)Online publication date: 16-Sep-2020
  • (2020)Contesting control: journeys through surrender, self-awareness and looseness of control in embodied interactionHuman–Computer Interaction10.1080/07370024.2020.175421436:5-6(361-389)Online publication date: 14-Oct-2020
  • (2019)Augmenting Guitars for Performance PreparationProceedings of the 14th International Audio Mostly Conference: A Journey in Sound10.1145/3356590.3356602(69-75)Online publication date: 18-Sep-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
AM '16: Proceedings of the Audio Mostly 2016
October 2016
285 pages
ISBN:9781450348225
DOI:10.1145/2986416
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 October 2016

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Musical codes
  2. music information retrieval
  3. performing

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

AM '16
AM '16: Audio Mostly 2016
October 4 - 6, 2016
Norrköping, Sweden

Acceptance Rates

AM '16 Paper Acceptance Rate 40 of 53 submissions, 75%;
Overall Acceptance Rate 177 of 275 submissions, 64%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)13
  • Downloads (Last 6 weeks)1
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2020)Following the journey of scores through a complex musical workProceedings of the 15th International Conference on Audio Mostly10.1145/3411109.3411116(249-252)Online publication date: 16-Sep-2020
  • (2020)Contesting control: journeys through surrender, self-awareness and looseness of control in embodied interactionHuman–Computer Interaction10.1080/07370024.2020.175421436:5-6(361-389)Online publication date: 14-Oct-2020
  • (2019)Augmenting Guitars for Performance PreparationProceedings of the 14th International Audio Mostly Conference: A Journey in Sound10.1145/3356590.3356602(69-75)Online publication date: 18-Sep-2019
  • (2019)Music, Design and Ethnography: An Interview with Steve BenfordNew Directions in Music and Human-Computer Interaction10.1007/978-3-319-92069-6_13(213-220)Online publication date: 7-Feb-2019
  • (2018)Designing the Audience Journey through Repeated ExperiencesProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174142(1-12)Online publication date: 21-Apr-2018
  • (2017)Crafting Interactive DecorationACM Transactions on Computer-Human Interaction10.1145/305855224:4(1-39)Online publication date: 11-Aug-2017
  • (2017)Playing Fast and Loose with Music RecognitionProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025900(4302-4313)Online publication date: 2-May-2017

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media