skip to main content
10.1145/2986416.2986438acmotherconferencesArticle/Chapter ViewAbstractPublication PagesamConference Proceedingsconference-collections
research-article

Streaming of Kinect Data for Interactive In-Browser Audio Performances

Authors Info & Claims
Published:04 October 2016Publication History

ABSTRACT

Distributed audio applications typically follow a server-client model, in which the server produces an audio stream that is sent to the client for consumption. Then, if any modification of the content is needed, it is a product of audio post-processing on the client side, which is computationally expensive. We tackle these challenges by separating the creative (input), from the sound processing (output) part. As a result, the application becomes lightweight in networking and computational metrics, while an extra level of control over the final output is added on the client. In order to demonstrate our solution, we present the architecture of a sample audio application that supports visualizations and uses Kinect as a controller.

References

  1. Paul Adenot, Chris Wilson, and Chris Rogers. 2013. Web Audio API. W3C, October 10 (2013).Google ScholarGoogle Scholar
  2. Demosthenes Akoumianakis, George Vellis, Ioannis Milolidakis, Dimitrios Kotsalis, and Chrisoula Alexandraki. 2008. Distributed Collective Practices in Collaborative Music Performance. In Proceedings of the 3rd international conference on Digital Interactive Media in Entertainment and Arts. ACM, 368--375. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Cyril Concolato, Jean Le Feuvre, and Romain Bouqueau. 2011. Usages of DASH for Rich Media Services. In Proceedings of the Second Annual ACM Conference on Multimedia Systems (MMSys '11). ACM, New York, NY, USA, 265--270. DOI: http://dx.doi.org/10.1145/1943552.1943587 Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Cyril Concolato, Jean Le Feuvre, and Emmanouil Potetsianakis. 2015. Synchronized Delivery of 3D Scenes With Audio and Video. In Proceedings of the 20th International Conference on 3D Web Technology. ACM, 245--248. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Cyril Concolato and Emmanouil Potetsianakis. 2015. In-Browser XML Document Streaming. In XML Prague 2015. 197--205.Google ScholarGoogle Scholar
  6. Eduardo Cuervo, Alec Wolman, Landon P Cox, Kiron Lebeck, Ali Razeen, Stefan Saroiu, and Madanlal Musuvathi. 2015. Kahawai: High-Quality Mobile Gaming Using GPU Offload. In Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 121--135. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Michael Gurevich. 2006. JamSpace: A Networked Real-Time Collaborative Music Environment. In CHI'06 extended abstracts on Human factors in computing systems. ACM, 821--826. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. ISO/IEC International Standard 14496-10. 2003. Information Technology --- Coding of Audio-visual Objects --- Part 10: Advanced Video Coding. (2003).Google ScholarGoogle Scholar
  9. Jarkko Juslin. 2016. Audio Synthesis and Effects Processing with Web Browser in Open Web. (2016).Google ScholarGoogle Scholar
  10. K. Kapetanakis, S. Panagiotakis, A.G. Malamos, and M. Zampoglou. 2014. Adaptive video streaming on top of Web3D: A bridging technology between X3DOM and MPEG-DASH. In Telecommunications and Multimedia (TEMU), 2014 International Conference on. 226--231. DOI:http://dx.doi.org/10.1109/TEMU.2014. 6917765Google ScholarGoogle ScholarCross RefCross Ref
  11. Christopher J Plack, Andrew J Oxenham, and Richard R Fay. 2006. Pitch: Neural Coding and Perception. Vol. 24. Springer Science & Business Media.Google ScholarGoogle Scholar
  12. E. Potetsianakis, E. Ksylakis, and G. Triantafyllidis. 2014. A Kinect-based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation. In Telecommunications and Multimedia (TEMU), 2014 International Conference on. 238--242. DOI: http://dx.doi.org/10.1109/TEMU.2014.6917767Google ScholarGoogle ScholarCross RefCross Ref
  13. Charlie Roberts and J Kuchera-Morin. 2012. Gibber: Live Coding Audio in The Browser. Ann Arbor, MI: Michigan Publishing, University of Michigan Library.Google ScholarGoogle Scholar
  14. Joseph Rothstein. 1995. MIDI: A comprehensive introduction. Vol. 7. AR Editions, Inc. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Iraj Sodagar. 2011. The MPEG-DASH Standard for Multimedia Streaming Over The Internet. IEEE MultiMedia 4 (2011), 62--67. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Streaming of Kinect Data for Interactive In-Browser Audio Performances

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Other conferences
              AM '16: Proceedings of the Audio Mostly 2016
              October 2016
              285 pages
              ISBN:9781450348225
              DOI:10.1145/2986416

              Copyright © 2016 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 4 October 2016

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • research-article
              • Research
              • Refereed limited

              Acceptance Rates

              AM '16 Paper Acceptance Rate40of53submissions,75%Overall Acceptance Rate177of275submissions,64%

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader