Article

Sketching articulation and pose for facial animation

Authors:

Odest Chadwicke JenkinsAuthors Info & Claims

SCA '06: Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation

Pages 271 - 280

Published: 02 September 2006 Publication History

Abstract

We present a method for articulating and posing meshes, in particular facial meshes, through a 2D sketching interface. Our method establishes an interface between 3D meshes and 2D sketching with the inference of reference and target curves. Reference curves allow for user selection of features on a mesh and their manipulation to match a target curve. Our articulation system uses these curves to specify the deformations of a character rig, forming a coordinate space of mesh poses. Given such a coordinate space, our posing system uses reference and target curves to find the optimal pose of the mesh with respect to the sketch input. We present results demonstrating the efficacy of our method for mesh articulation, mesh posing with articulations generated in both Maya and our sketch-based system, and mesh animation using human features from video. Through our method, we aim to both provide novice-accessible articulation and posing mesh interfaces and rapid prototyping of complex deformations for more experienced users.

References

[1]

{CB96} Covell M., Bregler C.: Eigen-points. In IEEE International Conference on Image Processing Proceedings (1996), pp. 471--474.]]

[2]

{CB02} Chuang E., Bregler C.: Performance Driven Facial Animation using Blendshape Interpolation. Tech. rep., Stanford University Computer Science, 2002.]]

[3]

{CJTF98} Corrêa W. T., Jensen R., Thayer C., Finkelstein A.: Texture mapping for cel animation. In SIGGRAPH 98 Proceedings (1998), pp. 435--446.]]

Digital Library

[4]

{DAC*03} Davis J., Agrawala M., Chuang E., Popović Z., Salesin D.: A sketching interface for articulated figure animation. In SIGGRAPH/Eurographics Symposium on Computer Animation Proceedings (2003), pp. 320--328.]]

Digital Library

[5]

{DE03} Draper G. M., Egbert P. K.: A gestural interface to free-form deformation. In Graphics Interface 2003 Proceedings (2003), pp. 113--120.]]

[6]

{GMHP04} Grochow K., Martin S. L., Hertzmann A., Popović: Style-based inverse kinematics. In SIGGRAPH 04 Proceedings (2004), pp. 522--531.]]

Digital Library

[7]

{HL94} Hsu S. C., Lee I. H. H.: Drawing and animation using skeletal strokes. In SIGGRAPH 94 Proceedings (1994), pp. 109--118.]]

Digital Library

[8]

{HQ03} Hua J., Qin H.: Free-form deformations via sketching and manipulating scalar fields. In ACM Symposium on Solid modeling and Applications Proceedings (2003), pp. 328--333.]]

Digital Library

[9]

{IH02} Igarashi T., Hughes J. F.: Clothing manipulation. In ACM Symposium on User Interface Software and Technology Proceedings (2002), pp. 91--100.]]

Digital Library

[10]

{IMT99} Igarashi T., Matsuoka S., Tanaka H.: Teddy: a sketching interface for 3d freeform design. In Graphics Interface 2003 Proceedings (1999), pp. 113--120.]]

Digital Library

[11]

{KG05} Kho Y., Garland M.: Sketching mesh deformations. In Symposium on Interactive 3D Graphics and Games Proceedings (2005), pp. 1142--1147.]]

Digital Library

[12]

{KHR02} Karpenko O., Hughes J., Raskar R.: Free-form sketching with variational implicit surfaces. In Computer Graphics Forum (2002), pp. 585--594.]]

[13]

{LCF00} Lewis J., Cordner M., Fong N.: Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation. In Conference on Computer Graphics and Interactive Techniques Proceedings (2000), pp. 165--172.]]

Digital Library

[14]

{LGXS03} Li Y., Gleicher M., Xu Y.-Q., Shum H.-Y.: Stylizing motion with drawings. In ACM SIGGRAPH/Eurographics Symposium on Computer animation (2003), pp. 309--319.]]

Digital Library

[15]

{NSACO05} Nealen A., Sorkine O., Alexa M., Cohen-Or D.: A sketch-based interface for detail-preserving mesh editing. In SIGGRAPH 05 Proceedings (2005), pp. 1142--1147.]]

Digital Library

[16]

{PFTV92} Press W. H., Flannery B. P., Teukolsky S. A., Vetterling W. T.: Numerical Recipes in C - The Art of Scientific Programming. Cambridge University Press, 1992, pp. 408--412.]]

Digital Library

[17]

{SD04} Swain M., Duncan B.: Sketchpose: Artist-friendly posing tool. SIGGRAPH 2004 Sketch, 2004.]]

[18]

{SF98} Singh K., Fiume E.: Wires: a geometric deformation technique. In Conference on Computer Graphics and Interactive Techniques Proceedings (1998), pp. 405--414.]]

Digital Library

[19]

{SHP04} Safanova A., Hodgins J. K., Pollard N. S.: Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces. In SIGGRAPH 04 Proceedings (2004), pp. 514--521.]]

Digital Library

[20]

{SP86} Sederberg T. W., Parry S. R.: Free-form deformation of solid geometric models. In Conference on Computer Graphics and Interactive Techniques Proceedings (1986), pp. 151--160.]]

Digital Library

[21]

{SRC01} Sloan P.-P. J., Rose C. F., Cohen M. F.: Shape by example. In Symposium on Interactive 3D Graphics Proceedings (2001), pp. 135--143.]]

Digital Library

[22]

{SZGP05} Sumner R. W., Zwicker M., Gotsman C., Popovic J.: Mesh-based inverse kinematics. In SIGGRAPH 05 Proceedings (2005), pp. 488--495.]]

Digital Library

[23]

{TBvdP04} Thorne M., Burke D., Van De Panne M.: Identifying and sketching the future: Motion doodles: an interface for sketching character motion. In SIGGRAPH 04 Proceedings (2004), pp. 424--431.]]

Digital Library

[24]

{ZSCS04} Zhang L., Snavely N., Curless B., Seitz S. M.: Spacetime faces: high resolution capture for modeling and animation. In SIGGRAPH 04 Proceedings (2004), pp. 548--558.]]

Digital Library

Cited By

Hahn FMutzel FCoros SThomaszewski BNitti MGross MSumner RBarbič JDeng Z(2015)Sketch abstractions for character posingProceedings of the 14th ACM SIGGRAPH / Eurographics Symposium on Computer Animation10.1145/2786784.2786785(185-191)Online publication date: 7-Aug-2015
https://dl.acm.org/doi/10.1145/2786784.2786785
Miranda JAlvarez XOrvalho JGutierrez DSousa AOrvalho VDo ELeon JHammond TNealen A(2011)Sketch expressProceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling10.1145/2021164.2021180(87-94)Online publication date: 5-Aug-2011
https://dl.acm.org/doi/10.1145/2021164.2021180
Sucontphunt TTunwattanapong BDeng ZNeumann UMould DNoël S(2010)Crafting 3D faces using free form portrait sketching and plausible texture inferenceProceedings of Graphics Interface 201010.5555/1839214.1839251(209-216)Online publication date: 31-May-2010
https://dl.acm.org/doi/10.5555/1839214.1839251
Show More Cited By

Index Terms

Sketching articulation and pose for facial animation
1. Computing methodologies
  1. Computer graphics
    1. Shape modeling
2. Theory of computation
  1. Randomness, geometry and discrete structures
    1. Computational geometry

Recommendations

Pose-space animation and transfer of facial details
SCA '08: Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation

This paper presents a novel method for real-time animation of highly-detailed facial expressions based on a multi-scale decomposition of facial geometry into large-scale motion and fine-scale details, such as expression wrinkles. Our hybrid animation is ...
Artist friendly facial animation retargeting
SA '11: Proceedings of the 2011 SIGGRAPH Asia Conference

This paper presents a novel facial animation retargeting system that is carefully designed to support the animator's workflow. Observation and analysis of the animators' often preferred process of key-frame animation with blendshape models informed our ...
Facial Animation
CA '96: Proceedings of the Computer Animation

This paper present an application to the facial animation of the D.O.G.M.A. (Deformation Of Geometrical Model Animated) model. We described an order-controlled animation, where a first set of orders simulate the contraction of different facial muscles, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SCA '06: Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation

September 2006

370 pages

ISBN:3905673347

General Chairs:
Carol O'Sullivan
Trinity College Dublin, Ireland
,
Fred Pighin
Industrial Light and Magic, USA

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
EUROGRAPHICS: The European Association for Computer Graphics

Publisher

Eurographics Association

Goslar, Germany

Publication History

Published: 02 September 2006

Check for updates

Qualifiers

Article

Conference

SCA06

Sponsor:

SIGGRAPH
EUROGRAPHICS

SCA06: The ACM SIGGRAPH / Eurographics Symposium on Computer Animation

September 2 - 4, 2006

Vienna, Austria

Acceptance Rates

Overall Acceptance Rate 183 of 487 submissions, 38%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
587
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hahn FMutzel FCoros SThomaszewski BNitti MGross MSumner RBarbič JDeng Z(2015)Sketch abstractions for character posingProceedings of the 14th ACM SIGGRAPH / Eurographics Symposium on Computer Animation10.1145/2786784.2786785(185-191)Online publication date: 7-Aug-2015
https://dl.acm.org/doi/10.1145/2786784.2786785
Miranda JAlvarez XOrvalho JGutierrez DSousa AOrvalho VDo ELeon JHammond TNealen A(2011)Sketch expressProceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling10.1145/2021164.2021180(87-94)Online publication date: 5-Aug-2011
https://dl.acm.org/doi/10.1145/2021164.2021180
Sucontphunt TTunwattanapong BDeng ZNeumann UMould DNoël S(2010)Crafting 3D faces using free form portrait sketching and plausible texture inferenceProceedings of Graphics Interface 201010.5555/1839214.1839251(209-216)Online publication date: 31-May-2010
https://dl.acm.org/doi/10.5555/1839214.1839251
Pei YZha H(2009)3D facial expression editing based on the dynamic graph modelProceedings of the 2009 IEEE international conference on Multimedia and Expo10.5555/1698924.1699258(1354-1357)Online publication date: 28-Jun-2009
https://dl.acm.org/doi/10.5555/1698924.1699258
Lau MChai JXu YShum H(2009)Face poserACM Transactions on Graphics10.1145/1640443.164044629:1(1-17)Online publication date: 15-Dec-2009
https://dl.acm.org/doi/10.1145/1640443.1640446
Bee NFalk BAndré EConati CBauer MOliver NWeld D(2009)Simplified facial animation control utilizing novel input devicesProceedings of the 14th international conference on Intelligent user interfaces10.1145/1502650.1502680(197-206)Online publication date: 8-Feb-2009
https://dl.acm.org/doi/10.1145/1502650.1502680
Sucontphunt TMo ZNeumann UDeng ZShaw CBartram L(2008)Interactive 3D facial expression posing through 2D portrait manipulationProceedings of Graphics Interface 200810.5555/1375714.1375745(177-184)Online publication date: 28-May-2008
https://dl.acm.org/doi/10.5555/1375714.1375745
Lau MChai JXu YShum HGleicher MThalmann D(2007)Face poserProceedings of the 2007 ACM SIGGRAPH/Eurographics symposium on Computer animation10.5555/1272690.1272712(161-170)Online publication date: 3-Aug-2007
https://dl.acm.org/doi/10.5555/1272690.1272712

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten