Neil Anthony Dodgson
Kathleen Griffin
ABSTRACT
Orchestral conducting involves a rich vocabulary of gestures and so training conductors is challenging. We discuss how virtual reality and gesture detection could be used to aid this process. We describe our pilot interface for training conductors in basic beat patterns, using gestural input and virtual reality output. We investigated both positional and acceleration-based detection of beats, concluding that that the best way to detect beats reliably is to identify maxima in acceleration, that is, those moments in a beat that would appear as a flick to a human player. This practical evidence supports Wöllner’s theory of how human players detect beats. We trialled our system with novices and experts, with a range of beating styles.
- J. O. Borchers. 1997. WorldBeat: Designing a baton-based interface for an interactive music exhibit. In SIGCHI. ACM, 131–138.Google Scholar
- J. O. Borchers, W. Samminger, and M. Muhlhauser. 2002. Personal Orchestra: conducting audio/video music recordings. In Proc. WEDELMUSIC. IEEE, 93–100.Google Scholar
- P.B. Braem and T. Bräm. 2000. A pilot study of the expressive gestures used by classical orchestral conductors. In The signs of language revisited, Karen Emmorey and Harlan L. Lane (Eds.). Lawrence Erlbaum Associates, 143–167.Google Scholar
- C. Demiralp, C.D. Jackson, D.B. Karelitz, S. Zhang, and D.H. Laidlaw. 2006. CAVE and fishtank virtual-reality displays: A qualitative and quantitative comparison. IEEE TVCG 12, 3 (2006), 323–330.Google Scholar
- Harold Farberman. 1997. The Art of Conducting Technique: A New Perspective. Alfred Music Publishing.Google Scholar
- P. Fleming, C. Young, S. Dixon, and M Carré. 2010. Athlete and coach perceptions of technology needs for evaluating running performance. Sports Engineering 13, 1 (2010), 1–18.Google ScholarCross Ref
- Benjamin Grosbayne. 1973. Techniques of Modern Orchestral Conducting. Harvard University Press.Google Scholar
- Robert T Hays, John W Jacobs, Carolyn Prince, and Eduardo Salas. 1992. Flight simulator training effectiveness: A meta-analysis. Military Psychology 4, 2 (1992), 63–74.Google ScholarCross Ref
- Alexander Refsum Jensenius. 2017. 2014: to gesture or not? An analysis of terminology in NIME proceedings 2001–2013. A NIME Reader: Fifteen Years of New Interfaces for Musical Expression (2017), 451–464.Google Scholar
- Geoff Luck and Sol Nte. 2008. An investigation of conductors’ temporal gestures and conductor—musician synchronization, and a first experiment. Psychology of Music 36, 1 (2008), 81–99.Google ScholarCross Ref
- Geoff Luck and John A Sloboda. 2009. Spatio-temporal cues for visually mediated synchronization. Music Perception 26, 5 (2009), 465–473.Google ScholarCross Ref
- Geoff Luck and Petri Toiviainen. 2006. Ensemble musicians’ synchronization with conductors’ gestures: An automated feature-extraction analysis. Music Perception 24, 2 (2006), 189–200.Google ScholarCross Ref
- B McElheran. 1989. Conducting Technique: for Beginners and Professionals (rev. ed.). Oxford University Press, New York, Oxford.Google Scholar
- Kenton O’Hara, Richard Harper, Helena Mentis, Abigail Sellen, and Alex Taylor. 2013. On the naturalness of touchless: putting the “interaction” back into NUI. ACM Transactions on Computer-Human Interaction 20, 1 (2013), 1–25.Google ScholarDigital Library
- Prabhat, A. Forsberg, M. Katzourin, K. Wharton, and M. Slater. 2008. A comparative study of desktop, fishtank, and cave systems for the exploration of volume rendered confocal data sets. IEEE TVCG 14, 3 (2008), 551–563.Google Scholar
- Edwin Roxburgh. 2014. Conducting for a new era. The Boydell Press, Woodbridge.Google Scholar
- M Rudolf. 1950. The Grammar of Conducting. Schirmer Books, New York.Google Scholar
- S. Schertenleib, M. Gutiérrez, F. Vexo, and D. Thalmann. 2004. Conducting a virtual orchestra. IEEE MultiMedia 11, 3 (2004), 40–49.Google ScholarDigital Library
- Christopher Seaman. 2013. Inside Conducting. University Rochester Press.Google Scholar
- J. Segen, J. Gluckman, and S. Kumar. 2000. Visual interface for conducting virtual orchestra. In ICPR. IEEE, 276–279.Google Scholar
- Clemens Wöllner and Wolfgang Auhagen. 2008. Perceiving conductors’ expressive gestures from different visual perspectives. An exploratory continuous response study. Music Perception 26, 2 (2008), 129–143.Google ScholarCross Ref
- C. Wöllner, F. J. A. Deconinck, J. Parkinson, M. J. Hove, and P. E. Keller. 2012. The perception of prototypical motion: Synchronization is enhanced with quantitatively morphed gestures of musical conductors. Journal of Experimental Psychology: Human Perception and Performance 38, 6 (2012), 1390–1403.Google ScholarCross Ref
Index Terms
- Training Orchestral Conductors in Beating Time
Recommendations
ZOOZbeat: mobile music recreation
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing SystemsZOOZbeat is a gesture-based Music reCreation studio. It is designed to provide users with expressive and creative access to music making on the go. ZOOZbeat users can compose user-generated songs based on generic beats in different styles or remix and ...
Personal orchestra: conducting audio/video music recordings
WEDELMUSIC'02: Proceedings of the Second international conference on Web delivering of musicPersonal Orchestra lets anybody conduct an electronic orchestra at a new level of realism: users interact not with a synthetic, but an original audio and video recording of a real orchestra--the Vienna Philharmonic. Nevertheless, they can interactively ...
Exploring percussive gesture on iPads with ensemble metatone
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsPercussionists are unique among western classical instrumentalists in that their artistic practice is defined by an approach to interaction rather than their instruments. While percussionists are accustomed to exploring non-traditional objects to create ...
Comments