Andrea Salgian
ABSTRACT
Music conductors are at a disadvantage compared to musicians playing an instrument, in that they don't receive immediate feedback during individual practice. Since the orchestra is not always readily available, beginner conductors practice in front of a mirror and are left to judge their own performance, which can be a pretty difficult and subjective task.
In this paper we present a low-cost computer-based system that, in addition to the mirror image, provides users with real time feedback about musical conducting performance. The system uses a Microsoft Kinect to track upper body joint coordinates, and a Myo armband to provide more exact arm positioning data. Using these devices, we are able to detect common mistakes such as swaying, rocking, excessive hinge movement, mirroring, and incorrect palm position, as well as measure tempo and classify the articulation type as staccato or legato.
The system has been well received by conducting students and their instructor, as it is very easy to set up and use, and it allows them to practice by themselves, without an orchestra.
- T. Baba, M. Hashida, and H. Katayose. 2010. "VirtualPhilharmony": A Conducting System with Heuristics of Conducting an Orchestra New Interfaces for Musical Expression (NIME). Sydney, Australia.Google Scholar
- R. Behringer. 2005. Conducting Digitally Stored Music by Computer Vision Tracking Proceedings of the First International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution (AXMEDIS?05). Florence, Italy. Google ScholarDigital Library
- Diana Hollinger and Jill M. Sullivan. 2007. The Effects of Technology-Based Conducting Practice on Skill Achievement in Novice Conductors. Research and Issues in Music Education Vol. 5, 1 (2007).Google Scholar
- P. Kolesnik and M. Wanderley. 2004. Recognition, Analysis and Performance with Expressive Conducting Gestures Proceedings of the International Computer Music Conference. Miami, FL.Google Scholar
- Thalmic Labs. 2015. Myo Armband. https://www.myo.com/. (2015). Accessed:2017-04-14.Google Scholar
- Y. K. Lim and W. S. Yeo. 2014. Smartphone-based Music Conducting. In New Interfaces for Musical Expression (NIME). London, UK.Google Scholar
- T. Marrin and J. Paradiso. 1997. The digital baton: A versatile performance instrument Proceedings of the International Computer Music Conference. Thessaloniki, Greece.Google Scholar
- Microsoft. 2013. Meet Kinect for Windows. https://developer.microsoft.com/en-us/windows/kinect. (2013). Accessed: 2017-04-14.Google Scholar
- D. Murphy, T. H. Andersen, and K. Jensen. 2003. Conducting audiofiles via computer vision. In Proceedings of the 5th International Gesture Workshop, LNAI. Genoa, Italy.Google Scholar
- T. M. Nakra, Y. Ivanov, P. Smaragdis, and C. Ault. 2009. The UBS Virtual Maestro: an Interactive Conducting System New Interfaces for Musical Expression (NIME). Pittsburgh, PA.Google Scholar
- Jerry Nowak. 2002. Conducting the music, not the musicians. Carl Fischer, New York.Google Scholar
- A. Salgian, L. Hsu, N. Milkosky, and D. Vickerman. 2015. Conductor Tutoring Using the Microsoft Kinect. In International Symposium on Visual Computing - Advances in Visual Computing. Pittsburgh, PA.Google Scholar
- A. Salgian and D. Vickerman. 2016. Computer-Based Tutoring for Conducting Students. Proceedings of the International Computer Music Conference. Utrecht, Netherlands.Google Scholar
- Dilip Swaminathan, Harvey Thornburg, Todd Ingalls, Stjepan Rajko, Jodi James, Ellen Campana, Kathleya Afanador, and Randal Leistikow. 2008. Computer Music Modeling and Retrieval. Sense of Sounds. Springer-Verlag, Berlin, Heidelberg, Chapter Capturing Expressive and Indicative Qualities of Conducting Gesture: An Application of Temporal Expectancy Models, 34--55. Google ScholarDigital Library
- S. Usa and Y. Mochida. 1998. A conducting recognition system on the model of musicians' process. J. Acoust. Soc. Jpn., Vol. 19, 4 (1998).Google ScholarCross Ref
- A. Wilson and A. Bobick. 1999. Realtime online adaptive gesture recognition. In Proceedings of the International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems. Corfu, Greece. Google ScholarDigital Library
Index Terms
- A Smart Mirror for Music Conducting Exercises
Recommendations
Music Control in an Interactive Conducting System Using Kinect
Music conducting is the art of directing musical ensembles with hand gestures to personalize and diversify a piece of music. Although the ability to successfully perform a musical piece demands intense training and coordination for the conductor and the ...
An analysis of basic expressive qualities in instrumental conducting
MOCO '15: Proceedings of the 2nd International Workshop on Movement and ComputingAdvances in sensing technology make the task of quantifying expressive human body movement more feasible than ever before. Success will enable breakthroughs in Human-computer interaction (HCI) and control paradigms. In most areas, however, expressivity ...
Conducting Digitally Stored Music by Computer Vision Tracking
AXMEDIS '05: Proceedings of the First International Conference on Automated Production of Cross Media Content for Multi-Channel DistributionIn this paper, a method for controlling electronic digital music instruments is proposed, based on visual capture of baton and hand motion of a conductor. This approach is suitable for being applied in mixed ensembles of human musicians and electronic ...
Comments