ABSTRACT
Facial expressions exhibit not only facial feature motions, but also subtle changes in illumination and appearance (e.g., facial creases and wrinkles). These details are important visual cues, but they are difficult to synthesize. Traditional expression mapping techniques consider feature motions while the details in illumination changes are ignored. In this paper, we present a novel technique for facial expression mapping. We capture the illumination change of one person's expression in what we call an expression ratio image (ERI). Together with geometric warping, we map an ERI to any other person's face image to generate more expressive facial expressions.
- 1.N.Badler and S.Platt.Animating facial expressions.In Computer Graphics ,pages 245 -252.Siggraph,August 1981. Google ScholarDigital Library
- 2.T.Beier and S.Neely.Feature-based image metamorphosis.In Computer Graphics ,pages 35 -42.Siggraph,July 1992. Google ScholarDigital Library
- 3.C.Bregler,M.Covell,and M.Slaney.Video rewrite:Driving visual speechwithaudio.In Computer Graphics ,pages 353 - 360.Siggraph,August 1997. Google ScholarDigital Library
- 4.S.E.Brennan.Caricature Generator .M.S.Visual Studies,Dept of Architecture,Massachusetts Institute of Technology,Cambridge,MA.,Sept.1982.Google Scholar
- 5.P.E.Debevec.Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography.In Computer Graphics,Annual Conference Series ,pages 189 -198.Siggraph, July 1998. Google ScholarDigital Library
- 6.P.E.Debevec,T.Hawkins,C.Tchou,H.-P.Duiker,W.Sarokin, and M.Sagar.Acquiring the re .ectance .eld of a human face.In Computer Graphics,Annual Conference Series ,pages 145 -156. Siggraph,July 2000. Google ScholarDigital Library
- 7.J.Foley,A.van Dam,S.Feiner,and J.Hughes.Computer Graphics:Principles and Practice .Addison-Wesley Publishing Company,1992. Google ScholarDigital Library
- 8.R.Gonzalez and R.Woods.Digital Image Processing .Addison- Wesley Publishing Company,1992. Google ScholarDigital Library
- 9.Y.Lee,D.Terzopoulos,and K.Waters.Realistic modeling for facial animation.In Computer Graphics ,pages 55 -62.Siggraph, August 1995. Google ScholarDigital Library
- 10.P.Litwinowicz and L.Williams.Animating images withdrawings.In Computer Graphics ,pages 235 -242.Siggraph,August 1990. Google ScholarDigital Library
- 11.S.R.Marschner and D.P.Greenberg.Inverse lighting for photography.In IST/SID Fifth Colort Imaging Conference ,November 1997.Google Scholar
- 12.S.R.Marschner,B.Guenter,and S.Raghupathy.Modeling and rendering for realistic facial animation.In Rendering Techniques ,pages 231 -242.Springer Wien New York,2000. Google ScholarDigital Library
- 13.F.I.Parke and K.Waters.Computer Facial Animation . AKPeters,Wellesley,Massachusetts,1996. Google ScholarDigital Library
- 14.F.Pighin,J.Hecker,D.Lischinski,R.Szeliski,and D.H.Salesin. Synthesizing realistic facial expressions from photographs.In Computer Graphics,Annual Conference Series ,pages 75 -84. Siggraph,July 1998. Google ScholarDigital Library
- 15.T.Riklin-Raviv and A.Shashua.The quotient image:Class based re-rendering and recongnition withvarying illuminations. In IEEE Conference on Computer Vision and Pattern Recognition ,pages 566 -571,June 1999.Google Scholar
- 16.S.M.Seize and C.R.Dyer.View morphing.In Computer Graphics ,pages 21 -30.Siggraph,August 1996. Google ScholarDigital Library
- 17.A.Stoschek.Image-based re-rendering of faces for continuous pose and illumination directions.In IEEE Conference on Computer Vision and Pattern Recognition ,pages 582 -587,2000.Google Scholar
- 18.D.Terzopoulos and K.Waters.Physically-based facial modeling and animation.Journal of Visualization and Computer Animation ,1(4):73 -80,March1990.Google ScholarCross Ref
- 19.K.Waters.A muscle model for animating three-dimensional facial expression.Computer Graphics ,22(4):17 -24,1987. Google ScholarDigital Library
- 20.L.Williams.Performace-driven facial animation.In Computer Graphics ,pages 235 -242.Siggraph,August 1990. Google ScholarDigital Library
- 21.G.Wolberg.Digital Image Warping .IEEE Computer Society Press,1990. Google ScholarDigital Library
Index Terms
- Expressive expression mapping with ratio images
Recommendations
Synthesizing realistic facial expressions from photographs
SIGGRAPH '05: ACM SIGGRAPH 2005 CoursesWe present new techniques for creating photorealistic textured 3D facial models from photographs of a human subject, and for creating smooth transitions between different facial expressions by morphing between these different models. Starting from ...
Expressive Facial Animation Synthesis by Learning Speech Coarticulation and Expression Spaces
Synthesizing expressive facial animation is a very challenging topic within the graphics community. In this paper, we present an expressive facial animation synthesis system enabled by automated learning from facial motion capture data. Accurate 3D ...
A Morphable Model For The Synthesis Of 3D Faces
Seminal Graphics Papers: Pushing the Boundaries, Volume 2In this paper, a new technique for modeling textured 3D faces is introduced. 3D faces can either be generated automatically from one or more photographs, or modeled directly through an intuitive user interface. Users are assisted in two key problems of ...
Comments