Motion templates for automatic classification and retrieval of motion capture data

ABSTRACT

This paper presents new methods for automatic classification and retrieval of motion capture data facilitating the identification of logically related motions scattered in some database. As the main ingredient, we introduce the concept of motion templates (MTs), by which the essence of an entire class of logically related motions can be captured in an explicit and semantically interpretable matrix representation. The key property of MTs is that the variable aspects of a motion class can be automatically masked out in the comparison with unknown motion data. This facilitates robust and efficient motion retrieval even in the presence of large spatio-temporal variations. Furthermore, we describe how to learn an MT for a specific motion class from a given set of training motions. In our extensive experiments, which are based on several hours of motion data, MTs proved to be a powerful concept for motion annotation and retrieval, yielding accurate results even for highly variable motion classes such as cartwheels, lying down, or throwing motions.

REFERENCES

• 1: Jackie Assa , Yaron Caspi , Daniel Cohen-Or, Action synopsis: pose selection and illustration, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 2: Okan Arikan , David A. Forsyth , James F. O'Brien, Motion synthesis from annotations, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 3: Matthew Brand , Aaron Hertzmann, Style machines, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.183-192, July 2000 [doi>10.1145/344779.344865]
• 4: Jernej Barbič , Alla Safonova , Jia-Yu Pan , Christos Faloutsos , Jessica K. Hodgins , Nancy S. Pollard, Segmenting motion capture data into distinct behaviors, Proceedings of the 2004 conference on Graphics interface, p.185-194, May 17-19, 2004, London, Ontario, Canada
• 5: Armin Bruderlin , Lance Williams, Motion signal processing, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.97-104, September 1995 [doi>10.1145/218380.218421]
• 6: Jinxiang Chai , Jessica K. Hodgins, Performance animation from low-dimensional control signals, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 7: {CMU03} CMU: http://mocap.cs.cmu.edu, 2003.
• 8: K. Forbes , E. Fiume, An efficient search algorithm for motion data using weighted PCA, Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 29-31, 2005, Los Angeles, California [doi>10.1145/1073368.1073377]
• 9: Ajo Fod , Maja J. Matarić , Odest Chadwicke Jenkins, Automated Derivation of Primitives for Movement Classification, Autonomous Robots, v.12 n.1, p.39-54, January 2002 [doi>10.1023/A:1013254724861 ]
• 10: {GG04} Green R., Guan L.: Quantifying and recognizing human movement patterns from monocular video images: Part I. IEEE Transactions on Circuits and Systems for Video Technology 14, 2 (February 2004), 179--190.
• 11: Martin A. Giese , Tomaso Poggio, Morphable Models for the Analysis and Synthesis of Complex Motion Patterns, International Journal of Computer Vision, v.38 n.1, p.59-73, June 2000 [doi>10.1023/A:1008118801668 ]
• 12: Eugene Hsu , Kari Pulli , Jovan Popović, Style translation for human motion, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 13: Lucas Kovar , Michael Gleicher, Flexible automatic motion blending with registration curves, Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 26-27, 2003, San Diego, California
• 14: Lucas Kovar , Michael Gleicher, Automated extraction and parameterization of motions in large data sets, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 15: {KPZ*04} Keogh E. J., Palpanas T., Zordan V. B., Gunopulos D., Cardle M.: Indexing large human-motion databases. In Proc. 30th VLDB Conf. (2004), pp. 780--791.
• 16: Guodong Liu , Jingdan Zhang , Wei Wang , Leonard McMillan, A system for analyzing and indexing human-motion databases, Proceedings of the 2005 ACM SIGMOD international conference on Management of data, June 14-16, 2005, Baltimore, Maryland [doi>10.1145/1066157.1066290]
• 17: Meinard Müller , Tido Röder , Michael Clausen, Efficient content-based retrieval of motion capture data, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 18: Katherine Pullen , Christoph Bregler, Motion capture assisted animation: texturing and synthesis, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 19: Charles Rose , Michael F. Cohen , Bobby Bodenheimer, Verbs and Adverbs: Multidimensional Motion Interpolation, IEEE Computer Graphics and Applications, v.18 n.5, p.32-40, September 1998 [doi>10.1109/38.708559 ]
• 20: {RF03} Ramanan D., Forsyth D. A.: Automatic annotation of everyday movements. In NIPS 16 (2003).
• 21: Lawrence Rabiner , Biing-Hwang Juang, Fundamentals of speech recognition, Prentice-Hall, Inc., Upper Saddle River, NJ, 1993
• 22: Yasuhiko Sakamoto , Shigeru Kuriyama , Toyohisa Kaneko, Motion map: image-based retrieval and segmentation of motion data, Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation, August 27-29, 2004, Grenoble, France [doi>10.1145/1028523.1028557]
• 23: {WCYL03} Wu M.-Y., Chao S., Yang S., Lin H.: Content-based retrieval for human motion data. In 16th IPPR Conf. on Comp. Vision, Graph., and Image Proc. (2003), pp. 605--612.
• 24: Andrew Witkin , Zoran Popovic, Motion warping, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.105-108, September 1995 [doi>10.1145/218380.218422]
• 25: Victor Brian Zordan , Anna Majkowska , Bill Chiu , Matthew Fast, Dynamic response for motion capture animation, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism