Article

Robot-human interaction with an anthropomorphic percussionist

Authors:

Scott DriscollAuthors Info & Claims

CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1229 - 1232

https://doi.org/10.1145/1124772.1124957

Published: 22 April 2006 Publication History

Abstract

The paper presents our approach for human-machine interaction with an anthropomorphic mechanical percussionist that can listen to live players, analyze perceptual musical aspects in real-time, and use the product of this analysis to play along in a collaborative manner. Our robot, named Haile, is designed to combine the benefits of computational power, perceptual modeling, and algorithmic music with the richness, visual interactivity, and expression of acoustic playing. We believe that when interacting with live players, Haile can facilitate a musical experience that is not possible by any other means, inspiring users to collaborate with it in novel and expressive manners. Haile can, therefore, serve a test-bed for novel forms of musical human-machine interaction, bringing perceptual aspects of computer music into the physical world both visually and acoustically.

References

[1]

Cope, D. Experiments in Music Intelligence. A-R Editions, Madison, WI, 1996.

[2]

Cycling74 - Max/MSP http://www.cycling74.com Accessed 2005.

[3]

Dannenberg, R. An On-line Algorithm for Real-Time Accompaniment. Proceedings of the 1984 International Computer Music Conference. Paris, France.

[4]

Desain, P. and Honing, H.J. Rhythmic stability as explanation of category size. Proceedings of the 2002 of the International Conference on Music Perception and Cognition Sydney CD-Rom.

[5]

Foote, J. and Uchihashi, S. The Beat Spectrum: a new approach to rhythmic analysis. Proceedings of the 2001 International Conference on Multimedia and Expo.

[6]

Jordà, S. Afasia: The Ultimate Homeric One-man multimedia- band. Proceedings of the 2002 Conference on New Interfaces for Musical Expression, Dublin, Ireland, (2002).

Digital Library

[7]

Lewis, G. Too Many Notes: Computers, Complexity and Culture in Voyager," Leonardo Music Journal 10 (2000) 33--39.

[8]

Makingthings - Teleo system http://www.makingthings.com

[9]

Pachet, F. The continuator: Musical interaction with style. Proceedings International Computer Music Conference, (2002) Goteborg, Sweden.

[10]

Paulus, J. and Kalpuri, A. Measuring the Similarity of Rhythmic Patterns. Proceedings of the 2002 International Conference on Music Information Retrieval. Paris, France.

[11]

Puckette, M. Real-time Audio Analysis Tools for Pd and MSP. Proceedings of the 1998 International Computer Music Conference. Cologne, Germany.

[12]

Rae, G. W. Robotic Instruments. http://logosfoundation.org/instrum_gwr/automatons.html

[13]

Rowe, R. Machine Musicianship. MIT press, 2004.

Digital Library

[14]

Scheirer, E. 1998. Tempo and beat analysis of acoustic musical signals. Journal of the Acoustical Society of America, 103:1 588--601.

[15]

Singer, E., Feddersen, J., Redmon, C. and Bowen B. LEMUR's Musical Robots. Proceedings of the Conference on New Interfaces for Musical Expression, Hamamatsu, Japan, (2004), pp.181--184.

Digital Library

[16]

Sony QRIO conductor Robot. http://www.sony.net/sonyInfo/QRIO/works/20040325e.html

[17]

Takanishi, A. Development of Anthropomorphic Flutist Robot WF-3RIV. Proceedings of International Computer Music Conference, Ann Arbor, Michigan, (1998) 328--331.

[18]

Tanguiane, A. Artificial Perception and Music Recognition. New York Springer-Verlag. 1993.

Digital Library

[19]

Toyota Trumpet Robot. http://www.toyota.co.jp/ en/special/robot

[20]

Weinberg G., Orth M., and Russo P. ""The Embroidered Musical Ball: A Squeezable Instrument for Expressive Performance," Proceeding of Computer Human Interaction Conference. (CHI 2000) The Hague.

Digital Library

[21]

Weinberg, G. Interconnected Musical Networks - Toward a Theoretical Framework. Computer Music Journal 29, 2 Cambridge MA: MIT Press (2005) 23--39.

Digital Library

[22]

Weinberg G., Driscoll S., Parry M. Musical Interactions with a Perceptual Robotic Percussionist. Proceedings of IEEE International Workshop on Robot and Human Interactive Communication. Nashville, TN (2005).

[23]

Winkler, T. 2001. Composing Interactive Music: Techniques and Ideas Using Max. Cambridge, MA MIT Press.

Digital Library

Cited By

Pu ISnyder JLeonard NJohal WLemaignan SBrščić DVázquez MCharisi V(2025)The Beatbots: A Musician-Informed Multi-Robot Percussion QuartetProceedings of the 2025 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3721488.3721501(65-74)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.5555/3721488.3721501
Gao XRogel ASankaranarayanan RDowling BWeinberg G(2024)Music, body, and machine: gesture-based synchronization in human-robot musical interactionFrontiers in Robotics and AI10.3389/frobt.2024.146161511Online publication date: 5-Dec-2024
https://doi.org/10.3389/frobt.2024.1461615
Elgarf MSalam HPeters C(2024)Fostering children’s creativity through LLM-driven storytelling with a social robotFrontiers in Robotics and AI10.3389/frobt.2024.145742911Online publication date: 13-Dec-2024
https://doi.org/10.3389/frobt.2024.1457429
Show More Cited By

Index Terms

Robot-human interaction with an anthropomorphic percussionist

Recommendations

The interactive robotic percussionist: new developments in form, mechanics, perception and interaction design
HRI '07: Proceedings of the ACM/IEEE international conference on Human-robot interaction

We present new developments in the improvisational robotic percussionist project, aimed at improving human-robot interaction through design, mechanics, and perceptual modeling. Our robot, named Haile, listens to live human players, analyzes perceptual ...
Shimon: an interactive improvisational robotic marimba player
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing Systems

Shimon is an autonomous marimba-playing robot designed to create interactions with human players that lead to novel musical outcomes. The robot combines music perception, interaction, and improvisation with the capacity to produce melodic and harmonic ...
Musical-based interaction system for the Waseda Flutist Robot

Since 1990, at Waseda University the development on the Anthropomorphic Flutist Robot has been focused on mechanically reproducing the physiology of the organs involved during the flute playing (i.e. lungs, lips, etc.) and implementing basic cognitive ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2006

1353 pages

ISBN:1595933727

DOI:10.1145/1124772

Editors:
Rebecca Grinter
Georgia Institute of Technology, USA
,
Thomas Rodden
University of Nottingham, UK
,
Paul Aoki
Intel, USA
,
Ed Cutrell
Microsoft, USA
,
Robin Jeffries
Google, USA
,
Gary Olson
University of Michigan, USA

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 April 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI06

Sponsor:

CHI06: CHI 2006 Conference on Human Factors in Computing Systems

April 22 - 27, 2006

Québec, Montréal, Canada

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
1,137
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Pu ISnyder JLeonard NJohal WLemaignan SBrščić DVázquez MCharisi V(2025)The Beatbots: A Musician-Informed Multi-Robot Percussion QuartetProceedings of the 2025 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3721488.3721501(65-74)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.5555/3721488.3721501
Gao XRogel ASankaranarayanan RDowling BWeinberg G(2024)Music, body, and machine: gesture-based synchronization in human-robot musical interactionFrontiers in Robotics and AI10.3389/frobt.2024.146161511Online publication date: 5-Dec-2024
https://doi.org/10.3389/frobt.2024.1461615
Elgarf MSalam HPeters C(2024)Fostering children’s creativity through LLM-driven storytelling with a social robotFrontiers in Robotics and AI10.3389/frobt.2024.145742911Online publication date: 13-Dec-2024
https://doi.org/10.3389/frobt.2024.1457429
Mahdi HAkgun SSaleh SDautenhahn K(2022)A survey on the design and evolution of social robots — Past, present and futureRobotics and Autonomous Systems10.1016/j.robot.2022.104193156:COnline publication date: 1-Oct-2022
https://dl.acm.org/doi/10.1016/j.robot.2022.104193
Hong JFischer KHa YZeng Y(2022)Human, I wrote a song for youComputers in Human Behavior10.1016/j.chb.2022.107239131:COnline publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1016/j.chb.2022.107239
Park GNan DPark EKim KHan Jdel Pobil A(2021)Computers as Social Actors? Examining How Users Perceive and Interact with Virtual Influencers on Social Media2021 15th International Conference on Ubiquitous Information Management and Communication (IMCOM)10.1109/IMCOM51814.2021.9377397(1-6)Online publication date: 4-Jan-2021
https://doi.org/10.1109/IMCOM51814.2021.9377397
Ince GYorganci ROzkul ADuman TKöse H(2020)An audiovisual interface-based drumming system for multimodal human–robot interactionJournal on Multimodal User Interfaces10.1007/s12193-020-00352-w15:4(413-428)Online publication date: 13-Nov-2020
https://doi.org/10.1007/s12193-020-00352-w
Weinberg GBretan MHoffman GDriscoll SWeinberg GBretan MHoffman GDriscoll S(2020)“Wear it”—Wearable Robotic MusiciansRobotic Musicianship10.1007/978-3-030-38930-7_7(213-254)Online publication date: 8-Feb-2020
https://doi.org/10.1007/978-3-030-38930-7_7
Wolf CBlomberg J(2019)Evaluating the Promise of Human-Algorithm Collaborations in Everyday Work PracticesProceedings of the ACM on Human-Computer Interaction10.1145/33592453:CSCW(1-23)Online publication date: 7-Nov-2019
https://dl.acm.org/doi/10.1145/3359245
McCallum LMcOwan P(2018)Extending Human–Robot Relationships Based in Music With Virtual PresenceIEEE Transactions on Cognitive and Developmental Systems10.1109/TCDS.2017.277921810:4(955-960)Online publication date: Dec-2018
https://doi.org/10.1109/TCDS.2017.2779218
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten