A hand clap interface for sonic interaction with the computer

ABSTRACT

We present a hand clapping interface for sonic interaction with the computer. The current implementation has been built on the Pure Data (PD) software. The interface makes use of the cyclic nature of hand clapping and recognition of the clap type, and enables interactive control over different applications. Three prototype applications for the interface are presented: a virtual crowd of clappers, controlling the tempo of music, and a simple sampler. Preliminary tests indicate that rather than having total control via the interface, the user negotiates with the computer to control the tempo.

References

1. Abowd, G. and Mynatt, E. Charting past, present, and future research in ubiquitous computing. ACM Trans. Computer-Human Interaction 7, 1 (2000), 29--58.
2. Bello, J.P., Daudet, L., Abdallah, S., Duxbury, C., Davies, M., and Sandler, M.B. A tutorial on onset detection in music signals. IEEE Trans. Speech and Audio Proc. 13, 5 (2005), 1035--1047.
3. Brewster, S., Lumsden, J., Bell, M., Hall, M., and Tasker, S. Multimodal 'eyes-free' interaction techniques for wearable devices. In Proc. CHI 2003, ACM Press (2003), 463--480.
4. Buxton, B., Gaver, W., and Bly, S. Auditory Interfaces: the Use of Non-Speech Audio at the Interface. Unfinished book manuscript, available at http://www.billbuxton.com/Audio.TOC.html.
5. Erkut, C., and Tahiroglu, K. ClaPD: A testbed for control of multiple sound sources in interactive and participatory contexts. In PureData Convention 2007. Online proc. at http://artengine.ca/~catalogue-pd.
6. Gaver, W. What in the World Do We Hear?: An Ecological Approach to Auditory Event Perception. Ecological Psychology 5, 1 (1993), 1--29.
7. Gouyon, F. and Dixon, S. A review of automatic rhythm description systems. Comp. Music J. 29, 1 (2005), 34--54.
8. Hanahara, K., Tada, Y., and Muroi, T. Human-robot communication by means of hand-clapping (preliminary experiment with hand-clapping language). In Proc. IEEE Intl. Conf. Systems, Man and Cybernetics, IEEE (2007), 2995--3000.
9. Jylhä, A. and Erkut, C. Inferring the hand configuration from hand clapping sounds. In Proc. DAFx--08, (2008), 301--304.
10. Jylhä, A. and Erkut, C. Sonic interactions with hand clap sounds. In Proc. Audio Mostly 2008, (2008), 93--100.
11. Norman, D. The Design of Future Things. Basic Books, New York, NY, USA, 2007.
12. Peltola, L., Erkut, C., Cook, P.R., and Välimäki, V. Synthesis of hand clapping sounds. IEEE Trans. Audio, Speech and Language Proc. 15, 3 (2007), 1021--1029.
13. Puckette, M. Pure data: Another integrated computer music environment. In Proc. Second Intercollege Comp. Music Concerts, (1996), 37--41.
14. Puckette, M., Apel, T., and Zicarelli, D. Real-time audio analysis tool for Pd and MSP. In Proc. Intl. Comp. Music Conf., (1998), 109--112.
15. Robare, P. and Forlizzi, J. Sound in computing: A short history. In interactions 16, 1 (2009), 62--65.
16. Seppänen, J. Computational Models of Musical Meter Recognition. Master's thesis, Tampere University of Technology, Finland, 2001.
17. Vesa, S. and Lokki, T. An eyes-free user interface controlled by finger snaps. In Proc DAFx-05, (2005), 262--265.

Index Terms

• Applied computing

  • Arts and humanities

    • Sound and music computing

• Information systems

  • Information retrieval

    • Specialized information retrieval

      • Multimedia and multimodal retrieval

        • Music retrieval