A sketching interface for articulated figure animation

ABSTRACT

We introduce a new interface for rapidly creating 3D articulated figure animation, from 2D sketches of the character in the desired key frame poses. Since the exact 3D animation corresponding to a set of 2D drawings is ambiguous we first reconstruct the possible 3D configurations and then apply a set of constraints and assumptions to present the user with the most likely 3D pose. The user can refine this candidate pose by choosing among alternate poses proposed by the system. This interface is supported by pose reconstruction and optimization methods specifically designed to work with imprecise hand drawn figures. Our system provides a simple, intuitive and fast interface for creating rough animations that leverages our users' existing ability to draw. The resulting key framed sequence can be exported to commercial animation packages for interpolation and additional refinement.

References

1. Blair, P., Cartoon Animation. 1994, Laguna Hills, California: Walter Foster Publishing.
2. Bregler, C., et al., Turning to the masters: motion capturing cartoons. ACM Transactions on Graphics, 2002. 21(3): p. 399--407.
3. Bregler, C. and J. Malik. Tracking people with twists and exponential maps. in IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 1998.
4. DiFranco, D., T.-J. Cham, and J. Rehg, Recovery of 3D Articulated Motion from 2D Correspondences. 1999, Compaq Cambridge Research Laboratory.
5. Gavrila, D. M., The visual analysis of human movement: a survey. Computer Vision and Image Understanding, 1999. 73(1): p. 82--98.
6. Girard, M. and A. A. Maciejewski. Computational modeling for the computer animation of legged figures. in Proceedings of ACM SIGGRAPH 85. 1985: ACM Press.
7. Gleicher, M. and N. Ferrier. Evaluating Video-Based Motion Capture. in Computer Animation 2002. 2002.
8. Hecker, R. and K. Perlin, Controlling 3D Objects by Sketching 2D Views. SPIE - Sensor Fusion V, 1992. 1828: p. 46--48.
9. Houy, D. R. Range of Joint Motion in College Males. in Proceedings of the Human Factors Society. 1983. Norfolk, Virginia.
10. Howe, N., M. Leventon, and W. Freeman, Bayesian Reconstruction of 3D Human Motion from Single-Camera Video. 1999, MERL - Mitsubishi Electric Research Laboratory.
11. Igarashi, T. and J. F. Hughes, A Suggestive Interface for 3D Drawing, in Proceedings of the ACM Symposium on User Interface Software and Technology, UIST 01. 2001, ACM: Orlando, Florida.
12. Igarashi, T., S. Matsuoka, and H. Tanaka, Teddy: A Sketching Interface for 3D Freeform Design, in Proceedings of SIGGRAPH 99. 1999, ACM SIGGRAPH / Addison Wesley Longman: Los Angeles, California. p. 409--416.
13. Korein, J. U., A geometric investigation of reach. 1985, Cambridge, MA, USA: MIT Press.
14. Lasseter, J., Tricks to Animating Characters with a Computer, in SIGGRAPH 94 Course Notes No 1. 1994: Orlando, Florida.
15. Lawrence, C. T., J. L. Zhou, and A. L. Tits, User's Guide for CFSQP Version 2.5d. 1993, Atlanta: AEM Design, Inc.
16. Lee, H.-J. and Z. Chen, Determination of 3D Human Body Postures from a Single View. Computer Vision, Graphics, and Image Processing, 1985. 30: p. 148--168.
17. Liu, C. K. and Z. Popovic, Synthesis of Complex Dynamic Character Motion from Simple Animations. SIGGRAPH 2002: ACM Transactions on Graphics, 2002. 21(3): p. 408--416.
18. Moeslund, T. B. and E. Granum, A survey of computer vision-based human motion capture. Computer Vision and Image Understanding, 2001. 81(3): p. 231--68.
19. Pullen, K. and C. Bregler, Motion Capture Assisted Animation: Texturing and Synthesis. SIGGRAPH 2002 : ACM Transactions on Graphics, 2002. 21(3): p. 501--508.
20. Rosales, R., et al., Estimating 3D Body Pose Using Uncali-brated Cameras, in In IEEE Computer Vision and Pattern Recognition, CVPR 01. 2001, IEEE.
21. Schmidt, D. C. and L. E. Druffel, A fast backtracking algorithm to test directed graphs for isomorphism under distance matrices. Journal of the Association for Computing Machinery, 1976. 23(3): p. 433--445.
22. Taylor, C. J., Reconstruction of Articulated Objects from Point Correspondences in a Single Uncalibrated Image. Computer Vision and Image Understanding, 2000. 80(3): p. 349--363.
23. Wilhelms, J. and A. Van Gelder, Fast and easy reach-cone joint limits. Journal of Graphics Tools, 2001. 6(no.2): p. 27--41.
24. Young, I. T., J. J. Gerbrands, and L. J. v. Vliet, Fundamentals of Image Processing. 1998: Delft University of Technology.
25. Zeleznik, R. C., K. P. Herndon, and J. F. Hughes, SKETCH: An Interface for Sketching 3D Scenes, in Proceedings of SIGGRAPH 96. 1996, ACM SIGGRAPH / Addison Wesley: New Orleans, Louisiana. p. 163--170.
26. Zhao, J. and N. I. Badler, Inverse Kinematics Positioning Using Nonlinear Porgramming for Highly Articulated Figures. ACM Transactions on Graphics, 1994. 13(4): p. 313--336.

Index Terms

• Applied computing

  • Document management and text processing

    • Document capture

      • Graphics recognition and interpretation

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Image and video acquisition

        • 3D imaging

  • Computer graphics

    • Animation

  • Modeling and simulation

    • Simulation types and techniques

      • Simulation by animation