skip to main content
10.1145/3173225.3173272acmconferencesArticle/Chapter ViewAbstractPublication PagesteiConference Proceedingsconference-collections
Work in Progress

Embodied Interactions with E-Textiles and the Internet of Sounds for Performing Arts

Authors Info & Claims
Published:18 March 2018Publication History

ABSTRACT

This paper presents initial steps towards the design of an embedded system for body-centric sonic performance. The proposed prototyping system allows performers to manipulate sounds through gestural interactions captured by textile wearable sensors. The e-textile sensor data control, in real-time, audio synthesis algorithms working with content from Audio Commons, a novel web-based ecosystem for re-purposing crowd-sourced audio. The system enables creative embodied music interactions by combining seamless physical e-textiles with web-based digital audio technologies.

References

  1. Melvin L. Alexenberg. 2011. The Future of Art in a Postdigital Age: From Hellenistic to Hebraic Consciousness (2nd ed.). Intellect Books, Bristol, UK. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Luigi Atzori, Antonio Iera, and Giacomo Morabito. 2010. The Internet of Things: A Survey. Computer Networks 54, 15 (2010), 2787--2805. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Tapomayukh Bhattacharjee, Advait Jain, Sarvagya Vaish, Marc D. Killpack, and Charles C. Kemp. 2013. Tactile Sensing over Articulated Joints with Stretchable Sensors. In Proceedings of the World Haptics Conference (WHC 2013). IEEE, 103--108.Google ScholarGoogle ScholarCross RefCross Ref
  4. Baptiste Caramiaux, Frédéric Bevilacqua, and Norbert Schnell. 2011. Sound Selection by Gestures. In Proceedings of the New Interfaces for Musical Expression (NIME '11).Google ScholarGoogle Scholar
  5. Lucy E. Dunne, Sarah Brady, Richard Tynan, Kim Lau, Barry Smyth, Dermot Diamond, and Gregory M.P. O'Hare. 2006. Garment-based Body Sensing Using Foam Sensors. In Proceedings of the 7th Australasian User Interface Conference - Volume 50 (AUIC '06). Australian Computer Society, Inc., 165--171. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Frederic Font, Tim Brookes, George Fazekas, Martin Guerber, Amaury La Burthe, David Plans, Mark D. Plumbley, Meir Shaashua, Wenwu Wang, and Xavier Serra. 2016. Audio Commons: Bringing Creative Commons Audio Content to the Creative Industries. In Proceedings of the 61st AES International Conference: Audio for Games. Audio Engineering Society.Google ScholarGoogle Scholar
  7. Frederic Font, Gerard Roma, and Xavier Serra. 2013. Freesound Technical Demo. In Proceedings of the 2013 ACM Multimedia Conference. ACM, 411--412. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Asif Ghias, Jonathan Logan, David Chamberlin, and Brian C. Smith. 1995. Query by Humming: Musical Information Retrieval in an Audio Database. In Proceedings of the Third ACM International Conference on Multimedia. ACM, 231--236. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Hilary Hutchinson, Wendy Mackay, Bo Westerlund, Benjamin B. Bederson, Allison Druin, Catherine Plaisant, Michel Beaudouin-Lafon, Stéphane Conversy, Helen Evans, Heiko Hansen, Nicolas Roussel, and Björn Eiderbäck. 2003. Technology Probes: Inspiring Design for and with Families. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 17--24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. James McCartney. 2002. Rethinking the Computer Music Language: SuperCollider. Computer Music Journal 26, 4 (2002), 61--68. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Andrew McPherson and Victor Zappi. 2015. An Environment for Submillisecond-Latency Audio and Sensor Processing on BeagleBone Black. In Audio Engineering Society Convention 138. Audio Engineering Society.Google ScholarGoogle Scholar
  12. Cheryl D. Metcalf, SRl Collie, A.W. Cranny, Georgie Hallett, Christopher James, Jo Adams, P.H. Chappell, N.M. White, and J.H. Burridge. 2009. Fabric-based Strain Sensors for Measuring Movement in Wearable Telemonitoring Applications. In Proceedings of the Assisted Living Conference. 1--4.Google ScholarGoogle Scholar
  13. Eduardo Reck Miranda and Marcelo M. Wanderley. 2006. New Digital Musical Instruments: Control and Interaction Beyond the Keyboard. Vol. 21. AR Editions, Inc.Google ScholarGoogle Scholar
  14. Tim Murray-Browne, Di Mainstone, Nick Bryan-Kinns, and Mark D. Plumbley. 2013. The Serendiptichord: Reflections on the Collaborative Design Process between Artist and Researcher. Leonardo 46, 1 (2013), 86--87.Google ScholarGoogle ScholarCross RefCross Ref
  15. Ivan Poupyrev, Rodney Berry, Jun Kurumisawa, Keiko Nakao, Mark Billinghurst, Chris Airola, Hirokazu Kato, Tomoko Yonezawa, and Lewis Baldwin. 2000. Augmented Groove: Collaborative Jamming in Augmented Reality. In Proceedings of the ACM SIGGRAPH 2000 Conference Abstracts and Applications. 77.Google ScholarGoogle Scholar
  16. Miller Puckette and others. 1996. Pure Data: Another Integrated Computer Music Environment. In Proceedings of the Second Intercollege Computer Music Concerts. 37--41.Google ScholarGoogle Scholar
  17. Gerard Roma and Xavier Serra. 2015. Querying Freesound with a Microphone. In Proceedings of the 1st Web Audio Conference (WAC '15).Google ScholarGoogle Scholar
  18. Kate Sicchio, Camille Baker, Tara Baoth Mooney, and Rebecca Stewart. 2016. Hacking the Body 2.0: Flutter/Stutter. In Proceedings of the International Conference on Live Interfaces (ICLI '16). 37--42.Google ScholarGoogle Scholar
  19. Sophie Skach, Patrick G.T. Healey, and Rebecca Stewart. 2017. Talking Through Your Arse: Sensing Conversation with Seat Covers. In Proceedings of the 39th Annual Meeting of the Cognitive Science Society (CogSci 2017). 3186--3190.Google ScholarGoogle Scholar
  20. Luca Turchet and Mathieu Barthet. 2017. Envisioning Smart Musical Haptic Wearables to Enhance Performers-Creative Communication. In Proceedings of International Symposium on Computer Music Multidisciplinary Research. 538--549.Google ScholarGoogle Scholar
  21. Luca Turchet, Carlo Fischione, and Mathieu Barthet. 2017. Towards the Internet of Musical Things. In Proceedings of the Sound and Music Computing Conference (SMC 2017). 13--20.Google ScholarGoogle Scholar
  22. Luca Turchet, Andrew McPherson, and Carlo Fischione. 2016. Smart Instruments: Towards an Ecosystem of Interoperable Devices Connecting Performers and Audiences. In Proceedings of the Sound and Music Computing Conference (SMC 2016). 498--505.Google ScholarGoogle Scholar
  23. Qi Wang. 2016. Designing Posture Monitoring Garments to Support Rehabilitation. In Proceedings of the Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16). ACM, 709--712. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Anna Xambó. 2017. In Digital Bodies: Creativity and Technology in the Arts and Humanities, Susan Broadhurst and Sara Price (Eds.). Palgrave Macmillan UK, London, Chapter Embodied music interaction: creative design synergies between music performance and HCI, 207--220.Google ScholarGoogle Scholar
  25. Anna Xambó, Carey Jewitt, and Sara Price. 2014. Towards an Integrated Methodological Framework for Understanding Embodiment in HCI. In Proceedings of the Extended Abstracts of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI EA '14). ACM, 1411--1416. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Embodied Interactions with E-Textiles and the Internet of Sounds for Performing Arts

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          TEI '18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction
          March 2018
          763 pages
          ISBN:9781450355681
          DOI:10.1145/3173225

          Copyright © 2018 Owner/Author

          Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 18 March 2018

          Check for updates

          Qualifiers

          • Work in Progress

          Acceptance Rates

          TEI '18 Paper Acceptance Rate37of130submissions,28%Overall Acceptance Rate393of1,367submissions,29%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader