ABSTRACT
This paper presents initial steps towards the design of an embedded system for body-centric sonic performance. The proposed prototyping system allows performers to manipulate sounds through gestural interactions captured by textile wearable sensors. The e-textile sensor data control, in real-time, audio synthesis algorithms working with content from Audio Commons, a novel web-based ecosystem for re-purposing crowd-sourced audio. The system enables creative embodied music interactions by combining seamless physical e-textiles with web-based digital audio technologies.
- Melvin L. Alexenberg. 2011. The Future of Art in a Postdigital Age: From Hellenistic to Hebraic Consciousness (2nd ed.). Intellect Books, Bristol, UK. Google ScholarDigital Library
- Luigi Atzori, Antonio Iera, and Giacomo Morabito. 2010. The Internet of Things: A Survey. Computer Networks 54, 15 (2010), 2787--2805. Google ScholarDigital Library
- Tapomayukh Bhattacharjee, Advait Jain, Sarvagya Vaish, Marc D. Killpack, and Charles C. Kemp. 2013. Tactile Sensing over Articulated Joints with Stretchable Sensors. In Proceedings of the World Haptics Conference (WHC 2013). IEEE, 103--108.Google ScholarCross Ref
- Baptiste Caramiaux, Frédéric Bevilacqua, and Norbert Schnell. 2011. Sound Selection by Gestures. In Proceedings of the New Interfaces for Musical Expression (NIME '11).Google Scholar
- Lucy E. Dunne, Sarah Brady, Richard Tynan, Kim Lau, Barry Smyth, Dermot Diamond, and Gregory M.P. O'Hare. 2006. Garment-based Body Sensing Using Foam Sensors. In Proceedings of the 7th Australasian User Interface Conference - Volume 50 (AUIC '06). Australian Computer Society, Inc., 165--171. Google ScholarDigital Library
- Frederic Font, Tim Brookes, George Fazekas, Martin Guerber, Amaury La Burthe, David Plans, Mark D. Plumbley, Meir Shaashua, Wenwu Wang, and Xavier Serra. 2016. Audio Commons: Bringing Creative Commons Audio Content to the Creative Industries. In Proceedings of the 61st AES International Conference: Audio for Games. Audio Engineering Society.Google Scholar
- Frederic Font, Gerard Roma, and Xavier Serra. 2013. Freesound Technical Demo. In Proceedings of the 2013 ACM Multimedia Conference. ACM, 411--412. Google ScholarDigital Library
- Asif Ghias, Jonathan Logan, David Chamberlin, and Brian C. Smith. 1995. Query by Humming: Musical Information Retrieval in an Audio Database. In Proceedings of the Third ACM International Conference on Multimedia. ACM, 231--236. Google ScholarDigital Library
- Hilary Hutchinson, Wendy Mackay, Bo Westerlund, Benjamin B. Bederson, Allison Druin, Catherine Plaisant, Michel Beaudouin-Lafon, Stéphane Conversy, Helen Evans, Heiko Hansen, Nicolas Roussel, and Björn Eiderbäck. 2003. Technology Probes: Inspiring Design for and with Families. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 17--24. Google ScholarDigital Library
- James McCartney. 2002. Rethinking the Computer Music Language: SuperCollider. Computer Music Journal 26, 4 (2002), 61--68. Google ScholarDigital Library
- Andrew McPherson and Victor Zappi. 2015. An Environment for Submillisecond-Latency Audio and Sensor Processing on BeagleBone Black. In Audio Engineering Society Convention 138. Audio Engineering Society.Google Scholar
- Cheryl D. Metcalf, SRl Collie, A.W. Cranny, Georgie Hallett, Christopher James, Jo Adams, P.H. Chappell, N.M. White, and J.H. Burridge. 2009. Fabric-based Strain Sensors for Measuring Movement in Wearable Telemonitoring Applications. In Proceedings of the Assisted Living Conference. 1--4.Google Scholar
- Eduardo Reck Miranda and Marcelo M. Wanderley. 2006. New Digital Musical Instruments: Control and Interaction Beyond the Keyboard. Vol. 21. AR Editions, Inc.Google Scholar
- Tim Murray-Browne, Di Mainstone, Nick Bryan-Kinns, and Mark D. Plumbley. 2013. The Serendiptichord: Reflections on the Collaborative Design Process between Artist and Researcher. Leonardo 46, 1 (2013), 86--87.Google ScholarCross Ref
- Ivan Poupyrev, Rodney Berry, Jun Kurumisawa, Keiko Nakao, Mark Billinghurst, Chris Airola, Hirokazu Kato, Tomoko Yonezawa, and Lewis Baldwin. 2000. Augmented Groove: Collaborative Jamming in Augmented Reality. In Proceedings of the ACM SIGGRAPH 2000 Conference Abstracts and Applications. 77.Google Scholar
- Miller Puckette and others. 1996. Pure Data: Another Integrated Computer Music Environment. In Proceedings of the Second Intercollege Computer Music Concerts. 37--41.Google Scholar
- Gerard Roma and Xavier Serra. 2015. Querying Freesound with a Microphone. In Proceedings of the 1st Web Audio Conference (WAC '15).Google Scholar
- Kate Sicchio, Camille Baker, Tara Baoth Mooney, and Rebecca Stewart. 2016. Hacking the Body 2.0: Flutter/Stutter. In Proceedings of the International Conference on Live Interfaces (ICLI '16). 37--42.Google Scholar
- Sophie Skach, Patrick G.T. Healey, and Rebecca Stewart. 2017. Talking Through Your Arse: Sensing Conversation with Seat Covers. In Proceedings of the 39th Annual Meeting of the Cognitive Science Society (CogSci 2017). 3186--3190.Google Scholar
- Luca Turchet and Mathieu Barthet. 2017. Envisioning Smart Musical Haptic Wearables to Enhance Performers-Creative Communication. In Proceedings of International Symposium on Computer Music Multidisciplinary Research. 538--549.Google Scholar
- Luca Turchet, Carlo Fischione, and Mathieu Barthet. 2017. Towards the Internet of Musical Things. In Proceedings of the Sound and Music Computing Conference (SMC 2017). 13--20.Google Scholar
- Luca Turchet, Andrew McPherson, and Carlo Fischione. 2016. Smart Instruments: Towards an Ecosystem of Interoperable Devices Connecting Performers and Audiences. In Proceedings of the Sound and Music Computing Conference (SMC 2016). 498--505.Google Scholar
- Qi Wang. 2016. Designing Posture Monitoring Garments to Support Rehabilitation. In Proceedings of the Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16). ACM, 709--712. Google ScholarDigital Library
- Anna Xambó. 2017. In Digital Bodies: Creativity and Technology in the Arts and Humanities, Susan Broadhurst and Sara Price (Eds.). Palgrave Macmillan UK, London, Chapter Embodied music interaction: creative design synergies between music performance and HCI, 207--220.Google Scholar
- Anna Xambó, Carey Jewitt, and Sara Price. 2014. Towards an Integrated Methodological Framework for Understanding Embodiment in HCI. In Proceedings of the Extended Abstracts of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI EA '14). ACM, 1411--1416. Google ScholarDigital Library
Index Terms
Embodied Interactions with E-Textiles and the Internet of Sounds for Performing Arts
Recommendations
Jamming with a Smart Mandolin and Freesound-based Accompaniment
FRUCT'23: Proceedings of the 23rd Conference of Open Innovations Association FRUCTThis paper presents an Internet of Musical Things ecosystem involving musicians and audiences interacting with a smart mandolin, smartphones, and the Audio Commons online repository Freesound. The ecosystem has been devised to sup- port performer-...
Cloud-smart Musical Instrument Interactions: Querying a Large Music Collection with a Smart Guitar
Large online music databases under Creative Commons licenses are rarely recorded by well-known artists, therefore conventional metadata-based search is insufficient in their adaptation to instrument players’ needs. The emerging class of smart musical ...
SOURCE: a Freesound Community Music Sampler
AM '21: Proceedings of the 16th International Audio Mostly ConferenceSOURCE is an open-source hardware music sampler powered by Freesound’s collection of near 500k Creative Commons sounds contributed by a community of thousands of people around the world. SOURCE provides a hardware interface with Freesound and ...
Comments