research-article

Synthesis of interactive hand manipulation

Author:

C. Karen LiuAuthors Info & Claims

SCA '08: Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation

Pages 163 - 171

Published: 07 July 2008 Publication History

Abstract

We present an interactive physics-based motion synthesis technique for creating hand manipulation across a wide variety of tasks, objects, user interventions, and stylistic preferences. Given an object being manipulated, a single pose specifying the desired initial contact, and the kinematic goals of the manipulation, our algorithm automatically generates hand-object manipulation that is responsive to unscripted external disturbances. Our algorithm simulates the dynamic coupling between a passive dynamic system and an active dynamic system by formulating a sequence of constrained optimizations. This formulation allows the user to synthesize a manipulation task by describing simple, keyframe-like kinematic goals in the domain of object configuration. The algorithm will automatically produce the hand motion that achieves the kinematic goals via coupled dynamic equations of motion.

References

[1]

{ABM82} Abend W., Bizzi E., Morasso P.: Human arm trajectory formation. Brain 105 (1982), 331--348.

[2]

{AH89} Atkeson C., Hollerbach J.: Kinematic features of unrestrained vertical arm movements. Journal of Neuroscience 5 (Sept. 1989), 2318--2330.

[3]

{AHS03} Albrecht I., Haber J., Seidel H.-P.: Construction and animation of anatomically based human hand models. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA-03) (Aire-la-Ville, July 2003), Breen D., Lin M., (Eds.), Eurographics Association, pp. 98--109.

Digital Library

[4]

{AN99} Aydin Y., Nakajima M.: Database guided computer animation of human grasping using forward and inverse kinematics. Computers and Graphics 23, 1 (1999), 145--154.

[5]

{BHM96} Buss M., Hashimoto H., Moore J. B.: Dextrous hand grasping force optimization. IEEE Transations on Robotics and Automation 12 (June 1996), 406--418.

[6]

{Bir94} Biryukova E.: A Model of Hand Dynamics. In Advances in the Biomechanics of Hand and Wrist. Plenum Press, 1994.

[7]

{BK00} Bicchi A., Kumar V.: Robotic grasping and contact: A review. In ICRA (2000), vol. 1, pp. 348--353.

[8]

{BLTK93} Bekey G. A., Liu H., Tomovic R., Karplus W. J.: Knowledge-based control of grasping in robot hands using heuristics from human motor skills. IEEE Transactions on Robotics and Automation 9, 6 (Dec. 1993), 709--721.

[9]

{BW92} Baraff D., Witkin A.: Dynamic simulation of non-penetrating flexible bodies. In SIGGRAPH (July 1992), vol. 26, pp. 303--308.

Digital Library

[10]

{ES03} ElKoura G., Singh K.: Handrix: Animating the human hand. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA-03) (Aire-la-Ville, July 2003), Breen D., Lin M., (Eds.), Eurographics Association, pp. 110--119.

Digital Library

[11]

{GSM96} Gill P., Saunders M., Murray W.: SNOPT: An SQP Algorithm for Large-scale Constrained Optimization. Tech. Rep. NA 96--2, University of California, San Diego, 1996.

[12]

{HBT95} Huang Z., Boulic R., Thalmann D.: A multi-sensor approach for grasping and 3-D interaction. In Computer Graphics International '95 (June 1995).

[13]

{HH97} Hajian A. Z., Howe R.: Identification of the mechanical impedance at the human finger tip. Journal of Biomechaniclal Engineering 119, 1 (1997), 109--114.

[14]

{Ibe97} Iberall T.: Human prehension and dextrous robot hands. International Journal of Robotics Researh 16, 3 (June 1997).

Digital Library

[15]

{Kaw99} Kawato M.: Internal models for motor control and trajectory planning. In Current Opinions in Neurobiology (1999), vol. 9.

[16]

{KCMT00} Kim J., Cordier F., Magnenat-Thalmann N.: Neural network-based violinistt's hand animation. In Proceedings of the Conference on Computer Graphics International (CGI-00) (Los Alamitos, CA, June 2000), IEEE, pp. 37--44.

Digital Library

[17]

{KKKL94} Koga Y., Kondo K., Kuffner J., Latombe J.-C.: Planning motions with intentions. In SIGGRAPH (July 1994), pp. 395--408.

Digital Library

[18]

{KL00} Kuffner J., Latombe J.-C.: Interactive manipulation planning for animated characters. In Pacific Graphics (Oct. 2000).

Digital Library

[19]

{Kog94} Koga Y.: On Computing Multi-arm Manipulation Trajectories. PhD thesis, Stanford University, Feb. 1994.

Digital Library

[20]

{KP06} Kry P. G., Pai D. K.: Interaction capture and synthesis. ACM Trans. on Graphics (SIGGRAPH) 25 (Aug. 2006), 872--880.

Digital Library

[21]

{LHP05} Liu C. K., Hertzmann A., Popović Z.: Learning physics-based motion style with nonlinear inverse optimization. ACM Trans. on Graphics (SIGGRAPH) 24, 3 (July 2005), 1071--1081.

Digital Library

[22]

{PZ05} Pollard N. S., Zordan V. B.: Physically based grasping control from example. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2005), Eurographics Association, pp. 311--318.

Digital Library

[23]

{Reu63} Reuleaux F.: Kinematics of Machinery. Dover, 1963.

[24]

{Sta91} Stansfield S.: Robotic grasping of unknown objects. The International Journal of Robotics Research 10, 4 (Aug. 1991), 314--326.

Digital Library

[25]

{TSF05} Tsang W., Singh K., Fiume E.: Helping hand: An anatomically accurate inverse dynamics solution for unconstrained hand motion. In Eurographics/SIGGRAPH Symposium on Computer Animation (2005), pp. 319--328.

Digital Library

[26]

{UKS89} Uno Y., Kawato M., Suzuki R.: Minimum muscle-tension-change model which reproduces human arm movement. In Symposium on Biological and Physiological Engineering (1989), pp. 299--302.

[27]

{VI90} Venkaraman S. T., Iberall T.: Dextrous Robot Hands. New York: Springer-Veriag, 1990.

Digital Library

[28]

{YKH04} Yamane K., Kuffner J. J., Hodgins J. K.: Synthesizing animations of human manipulation tasks. ACM Trans. Graph 23, 3 (2004), 532--539.

Digital Library

Cited By

Wang RXu PShi HSchumann ELiu C(2024)FürElise: Capturing and Physically Synthesizing Hand Motion of Piano PerformanceSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687703(1-11)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3680528.3687703
Xu PWang R(2024)Synchronize Dual Hands for Physics-Based Dexterous Guitar PlayingSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687692(1-11)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3680528.3687692
Lakshmipathy AFeng NLee YMahler MPollard N(2023)Contact Edit: Artist Tools for Intuitive Modeling of Hand-Object InteractionsACM Transactions on Graphics10.1145/359211742:4(1-20)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592117
Show More Cited By

Index Terms

Synthesis of interactive hand manipulation
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics
    1. Animation

Recommendations

Repurposing hand animation for interactive applications
SCA '16: Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation

In this paper we describe a method for automatically animating interactive characters based on an existing corpus of key-framed hand-animation. The method learns separate low-dimensional embeddings for subsets of the hand-animation corresponding to ...
Interactive animation of dynamic manipulation
SCA '06: Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation

Lifelike animation of object manipulation requires dynamic interaction between animated characters, objects, and their environment. These interactions can be animated automatically with physically based simulations but proper controls are needed to ...
Interactive manipulation of rigid body simulations
SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques

Physical simulation of dynamic objects has become commonplace in computer graphics because it produces highly realistic animations. In this paradigm the animator provides few physical parameters such as the objects' initial positions and velocities, and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SCA '08: Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation

July 2008

230 pages

ISBN:9783905674101

Conference Chairs:
Eugene Fiume,
Jerry Tessendorf,
Program Chairs:
Markus Gross,
Doug James

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
EUROGRAPHICS: The European Association for Computer Graphics

Publisher

Eurographics Association

Goslar, Germany

Publication History

Published: 07 July 2008

Check for updates

Qualifiers

Research-article

Conference

SCA08

Sponsor:

SIGGRAPH
EUROGRAPHICS

SCA08: The ACM SIGGRAPH / Eurographics Symposium on Computer Animation

July 7 - 9, 2008

Dublin, Ireland

Acceptance Rates

SCA '08 Paper Acceptance Rate 24 of 60 submissions, 40%;

Overall Acceptance Rate 183 of 487 submissions, 38%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
276
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang RXu PShi HSchumann ELiu C(2024)FürElise: Capturing and Physically Synthesizing Hand Motion of Piano PerformanceSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687703(1-11)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3680528.3687703
Xu PWang R(2024)Synchronize Dual Hands for Physics-Based Dexterous Guitar PlayingSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687692(1-11)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3680528.3687692
Lakshmipathy AFeng NLee YMahler MPollard N(2023)Contact Edit: Artist Tools for Intuitive Modeling of Hand-Object InteractionsACM Transactions on Graphics10.1145/359211742:4(1-20)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592117
Yang ZYin KLiu L(2022)Learning to use chopsticks in diverse gripping stylesACM Transactions on Graphics10.1145/3528223.353005741:4(1-17)Online publication date: 22-Jul-2022
https://dl.acm.org/doi/10.1145/3528223.3530057
Jörg SYe YMueller FNeff MZordan V(2020)Virtual hands in VRSIGGRAPH Asia 2020 Courses10.1145/3415263.3419155(1-32)Online publication date: 17-Nov-2020
https://dl.acm.org/doi/10.1145/3415263.3419155
Jörg SYe YNeff MMueller FZordan V(2020)Virtual hands in VRACM SIGGRAPH 2020 Courses10.1145/3388769.3407494(1-145)Online publication date: 17-Aug-2020
https://dl.acm.org/doi/10.1145/3388769.3407494
Canales RNormoyle ASun YYe YLuca MJörg S(2019)Virtual Grasping Feedback and Virtual Hand OwnershipACM Symposium on Applied Perception 201910.1145/3343036.3343132(1-9)Online publication date: 19-Sep-2019
https://dl.acm.org/doi/10.1145/3343036.3343132
Lee SYu RPark JAanjaneya MSifakis ELee J(2018)Dexterous manipulation and control with volumetric musclesACM Transactions on Graphics10.1145/3197517.320133037:4(1-13)Online publication date: 30-Jul-2018
https://dl.acm.org/doi/10.1145/3197517.3201330
Aristidou A(2018)Hand tracking with physiological constraintsThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-016-1327-834:2(213-228)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.1007/s00371-016-1327-8
Bai YYu WLiu CGomes APurgathofer WJorge JLin M(2016)Dexterous manipulation of clothProceedings of the 37th Annual Conference of the European Association for Computer Graphics10.5555/3058909.3058978(523-532)Online publication date: 9-May-2016
https://dl.acm.org/doi/10.5555/3058909.3058978
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten