Article

Physically based grasping control from example

Authors:

Nancy S. Pollard,

Victor Brian ZordanAuthors Info & Claims

SCA '05: Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation

Pages 311 - 318

https://doi.org/10.1145/1073368.1073413

Published: 29 July 2005 Publication History

Abstract

Animated human characters in everyday scenarios must interact with the environment using their hands. Captured human motion can provide a database of realistic examples. However, examples involving contact are difficult to edit and retarget; realism can suffer when a grasp does not appear secure or when an apparent impact does not disturb the hand or the object. Physically based simulations can preserve plausibility through simulating interaction forces. However, such physical models must be driven by a controller, and creating effective controllers for new motion tasks remains a challenge. In this paper, we present a controller for physically based grasping that draws from motion capture data. Our controller explicitly includes passive and active components to uphold compliant yet controllable motion, and it adds compensation for movement of the arm and for gravity to make the behavior of passive and active components less dependent on the dynamics of arm motion. Given a set of motion capture grasp examples, our system solves for all but a small set of parameters for this controller automatically. We demonstrate results for tasks including grasping and two-hand interaction and show that a controller derived from a single motion capture example can be used to form grasps of different object geometries.

References

[1]

{AHS03} Albrecht I., Haber J., Seidel H.-P.: Construction and animation of anatomically based human hand models. In ACM SIGGRAPH / Eurographics Symposium on Computer Animation (2003).

Digital Library

[2]

{AN99} Aydin Y., Nakajima M.: Database guided computer animation of human grasping using forward and inverse kinematics. Computers and Graphics 23 (1999), 145--154.

[3]

{BI05} Borst C. W., Indugula A. P.: Realistic virtual grasping. In IEEE Virtual Reality (2005).

Digital Library

[4]

{Bic00} Bicchi A.: Hands for dexterous manipulation and robust grasping: A difficult road toward simplicity. IEEE Transactions on Robotics and Automation 16, 6 (2000), 652--662.

[5]

{BLTK93} Bekey G. A., Liu H., Tomovic R., Karplus W. J.: Knowledge-based control of grasping in robot hands using heuristics from human motor skills. IEEE Transactions on Robotics and Automation 9, 6 (1993), 709--722.

[6]

{BP78} Bizzi E., Polit A.: Processes controlling arm movements in monkeys. Science 201 (1978), 1235--1237.

[7]

{ES03} Elkoura G., Singh K.: Handrix: Animating the human hand. In ACM SIGGRAPH / Eurographics Symposium on Computer Animation (2003).

Digital Library

[8]

{Fla87} Flash T.: The control of hand equilibrium trajectories in multi-joint arm movements. Biological Cybernetics 57, 4--5 (1987), 257--274.

Digital Library

[9]

{FOL*98} Feldman A. G., Ostry D. J., Levin M. F., Gribble P. L., Mitnitski A. B.: Recent tests of the equilibrium-point hypothesis (lambda model). Motor Control 2 (1998), 189--205.

[10]

{FvdPT01} Faloutsos P., Van De Panne M., Terzopoulos D.: Composable controllers for physics-based character animation. In SIGGRAPH 01 Proceedings (2001).

Digital Library

[11]

{GK96} Gomi H., Kawato M.: Equilibrium-point control hypothesis examined by measured arm stiffness during multijoint movement. Science 272 (1996), 117--120.

[12]

{GT95} Grzeszczuk R., Terzopoulos D.: Automated learning muscle-actuated locomotion through control abstraction. In SIGGRAPH 95 Proceedings (1995), pp. 63--70.

Digital Library

[13]

{HBMT95} Huang Z., Boulic R., Magnenat Thalmann N., Thalmann D.: A multi-sensor approach for grasping and 3D interaction. In Proc. Computer Graphics International (1995).

[14]

{HH97} Hajian A. Z., Howe R. D.: Identification of the mechanical impedance at the human finger tip. Journal of Biomechanical Engineering 119 (1997), 109--114.

[15]

{HM03} Hinder M. R., Milner T. E.: The case an internal dynamics model versus equilibrium point control in human movement. Journal of Physiology 549 (2003), 953--963.

[16]

{HWBO95} Hodgins J. K., Wooten W. L., Brogan D. C., O'Brien J. F.: Animating human athletics. In SIGGRAPH 95 Proceedings (1995), pp. 71--78.

Digital Library

[17]

{Ibe97} Iberall T.: Human prehension and dextrous robot hands. International Journal Robotics Research 16, 3 (June 1997).

Digital Library

[18]

{Kaw99} Kawato M.: Internal models for motor control and trajectory planning. Current Opinions in Neurobiology 9 (1999), 718--727.

[19]

{KCM00} Kim J., Cordier F., Magnenat Thalmann N.: Neural network-based violinist's hand animation. In Proc. Computer Graphics International (2000).

Digital Library

[20]

{KCS03} Kamper D. G., Cruz E. G., Siegel M. P.: Stereotypical fingertip trajectories during grasp. Journal of Neurophysiology 90 (2003), 3702--3710.

[21]

{KI97} Kang S. B., Ikeuchi K.: Toward automatic robot instruction from perception-mapping human grasps to manipulator grasps. IEEE Transactions on Robotics and Automation 13, 1 (1997), 81--95.

[22]

{LvF96} Laszlo J., Van De Panne M., Fiume E.: Limit cycle control and its application to the animation of balancing and walking. In SIGGRAPH 96 Proceedings (1996), pp. 155--162.

Digital Library

[23]

{MF98} Milner T. E., Franklin D. W.: Characterization of multijoint finger stiffness: Dependence on finger posture and force direction. IEEE Transactions on Biomedical Engineering 45, 11 (1998), 1363--1375.

[24]

{MI94} MacKenzie C. L., Iberall T.: The Grasping Hand. North-Holland, 1994.

[25]

{MT94} Mas Sanso R., Thalmann D.: A hand control and automatic grasping system for synthetic actors. In Eurographics '94 (1994).

[26]

{Pla00} Playter R.: Physics-based simulation of running using motion capture. In Course notes for SIGGRAPH 2000 (2000).

[27]

{RG91} Rijpkema H., Girard M.: Computer animation of knowledge-based human grasping. In Computer Graphics (SIGGRAPH 91 Proceedings) (1991), vol. 25, pp. 339--348.

Digital Library

[28]

{SFS02} Santello M., Flanders M., Soechting J. F.: Patterns of hand motion during grasping and the influence of sensory guidance. Journal of Neuroscience 22 (2002), 1426--1435.

[29]

{Sim94} Sims K.: Evolving virtual creatures. In SIGGRAPH 94 Proceedings (1994), pp. 15--22.

Digital Library

[30]

{SPF03} Shapiro A., Pighin F., Faloutsos P.: Hybrid control for interactive character animation. In Pacific Graphics (2003), pp. 455--461.

Digital Library

[31]

{vF93} Van De Panne M., Fiume E.: Sensor-actuator networks. In SIGGRAPH 93 Proceedings (1993), pp. 335--342.

Digital Library

[32]

{YCP03} Yin K., Cline M. B., Pai D. K.: Motion perturbation based on simple neuromotor control models. In Pacific Graphics (2003).

Digital Library

[33]

{ZH02} Zordan V. B., Hodgins J. K.: Motion capture-driven simulations that hit and react. In ACM SIGGRAPH / Eurographics Symposium on Computer Animation (2002).

Digital Library

[34]

{ZH03} Zordan V. B., Horst N. V. D.: Mapping optical motion capture data to skeletal motion using a physical model. In ACM SIGGRAPH / Eurographics Symposium on Computer Animation (2003), pp. 140--145.

Digital Library

Cited By

Xu PWang R(2024)Synchronize Dual Hands for Physics-Based Dexterous Guitar PlayingSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687692(1-11)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3680528.3687692
Zhou MAburumman N(2024)Grasping Objects in Immersive Virtual Reality Environments: Challenges and Current Techniques2024 10th International Conference on Virtual Reality (ICVR)10.1109/ICVR62393.2024.10867935(190-197)Online publication date: 24-Jul-2024
https://doi.org/10.1109/ICVR62393.2024.10867935
Zhang WHuang MZhou YZhang JYu JWang JXu L(2024)BOTH2Hands: Inferring 3D Hands from Both Text Prompts and Body Dynamics2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00232(2393-2404)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.00232
Show More Cited By

Index Terms

Physically based grasping control from example
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
    2. Rendering

Recommendations

Robust realtime physics-based motion control for human grasping

This paper presents a robust physics-based motion control system for realtime synthesis of human grasping. Given an object to be grasped, our system automatically computes physics-based motion control that advances the simulation to achieve realistic ...
Physically-based forehead animation including wrinkles

Physically-based animation techniques enable more realistic and accurate animation to be created. We present a fully physically-based approach for efficiently producing realistic-looking animations of facial movement, including animation of expressive ...
Physically-based virtual glove puppet
Edutainment'11: Proceedings of the 6th international conference on E-learning and games, edutainment technologies

Glove puppetry in Taiwan is a popular performing art. In this paper, we present a physically-based virtual glove puppet system which simulates the dynamics of glove puppet and allows user to interactively observe and manipulate the motion of the virtual ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SCA '05: Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation

July 2005

366 pages

ISBN:1595931988

DOI:10.1145/1073368

Conference Chairs:
Demetri Terzopoulos
New York University, USA
,
Victor Brian Zordan
University of California at Riverside, USA
,
Program Chairs:
Ken Anjyo
OLM Digital, Inc., Japan
,
Petros Faloutsos
University of California at Los Angeles, USA

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
EUROGRAPHICS: The European Association for Computer Graphics

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 July 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SCA05

Sponsor:

SIGGRAPH
EUROGRAPHICS

SCA05: Symposium on Computer Animation

July 29 - 31, 2005

California, Los Angeles

Acceptance Rates

Overall Acceptance Rate 183 of 487 submissions, 38%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

146
Total Citations
View Citations
1,037
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Xu PWang R(2024)Synchronize Dual Hands for Physics-Based Dexterous Guitar PlayingSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687692(1-11)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3680528.3687692
Zhou MAburumman N(2024)Grasping Objects in Immersive Virtual Reality Environments: Challenges and Current Techniques2024 10th International Conference on Virtual Reality (ICVR)10.1109/ICVR62393.2024.10867935(190-197)Online publication date: 24-Jul-2024
https://doi.org/10.1109/ICVR62393.2024.10867935
Zhang WHuang MZhou YZhang JYu JWang JXu L(2024)BOTH2Hands: Inferring 3D Hands from Both Text Prompts and Body Dynamics2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00232(2393-2404)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.00232
Shimada SMueller FBednarik JDoosti BBickel BTang DGolyanik VTaylor JTheobalt CBeeler T(2024)MACS: Mass Conditioned 3D Hand and Object Motion Synthesis2024 International Conference on 3D Vision (3DV)10.1109/3DV62453.2024.00082(1082-1091)Online publication date: 18-Mar-2024
https://doi.org/10.1109/3DV62453.2024.00082
Taheri OZhou YTzionas DZhou YCeylan DPirk SBlack M(2024)GRIP: Generating Interaction Poses Using Spatial Cues and Latent Consistency2024 International Conference on 3D Vision (3DV)10.1109/3DV62453.2024.00064(933-943)Online publication date: 18-Mar-2024
https://doi.org/10.1109/3DV62453.2024.00064
Huang ZDai SXu KZhang HHuang HHu R(2024)DINA: Deformable INteraction AnalogyGraphical Models10.1016/j.gmod.2024.101217133(101217)Online publication date: Jun-2024
https://doi.org/10.1016/j.gmod.2024.101217
Mangalam MOruganti SBuckingham GBorst C(2024)Enhancing hand-object interactions in virtual reality for precision manual tasksVirtual Reality10.1007/s10055-024-01055-328:4Online publication date: 5-Nov-2024
https://dl.acm.org/doi/10.1007/s10055-024-01055-3
YAN YCHENG YCHEN ZPENG YWU SZHANG WLI JLI YGAO JZHANG WZHAI GYANG X(2023)A survey on generative 3D digital humans based on neural networks: representation, rendering, and learningSCIENTIA SINICA Informationis10.1360/SSI-2022-031953:10(1858)Online publication date: 13-Oct-2023
https://doi.org/10.1360/SSI-2022-0319
Merrell P(2023)Example-Based Procedural Modeling Using Graph GrammarsACM Transactions on Graphics10.1145/359211942:4(1-16)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592119
Sun JDeng LAfouras TOwens ADavis A(2023)Eventfulness for Interactive Video AlignmentACM Transactions on Graphics10.1145/359211842:4(1-10)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592118
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten