skip to main content
10.1145/383259.383289acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
Article

Expressive expression mapping with ratio images

Published:01 August 2001Publication History

ABSTRACT

Facial expressions exhibit not only facial feature motions, but also subtle changes in illumination and appearance (e.g., facial creases and wrinkles). These details are important visual cues, but they are difficult to synthesize. Traditional expression mapping techniques consider feature motions while the details in illumination changes are ignored. In this paper, we present a novel technique for facial expression mapping. We capture the illumination change of one person's expression in what we call an expression ratio image (ERI). Together with geometric warping, we map an ERI to any other person's face image to generate more expressive facial expressions.

References

  1. 1.N.Badler and S.Platt.Animating facial expressions.In Computer Graphics ,pages 245 -252.Siggraph,August 1981. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. 2.T.Beier and S.Neely.Feature-based image metamorphosis.In Computer Graphics ,pages 35 -42.Siggraph,July 1992. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. 3.C.Bregler,M.Covell,and M.Slaney.Video rewrite:Driving visual speechwithaudio.In Computer Graphics ,pages 353 - 360.Siggraph,August 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. 4.S.E.Brennan.Caricature Generator .M.S.Visual Studies,Dept of Architecture,Massachusetts Institute of Technology,Cambridge,MA.,Sept.1982.Google ScholarGoogle Scholar
  5. 5.P.E.Debevec.Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography.In Computer Graphics,Annual Conference Series ,pages 189 -198.Siggraph, July 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. 6.P.E.Debevec,T.Hawkins,C.Tchou,H.-P.Duiker,W.Sarokin, and M.Sagar.Acquiring the re .ectance .eld of a human face.In Computer Graphics,Annual Conference Series ,pages 145 -156. Siggraph,July 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. 7.J.Foley,A.van Dam,S.Feiner,and J.Hughes.Computer Graphics:Principles and Practice .Addison-Wesley Publishing Company,1992. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. 8.R.Gonzalez and R.Woods.Digital Image Processing .Addison- Wesley Publishing Company,1992. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. 9.Y.Lee,D.Terzopoulos,and K.Waters.Realistic modeling for facial animation.In Computer Graphics ,pages 55 -62.Siggraph, August 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. 10.P.Litwinowicz and L.Williams.Animating images withdrawings.In Computer Graphics ,pages 235 -242.Siggraph,August 1990. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. 11.S.R.Marschner and D.P.Greenberg.Inverse lighting for photography.In IST/SID Fifth Colort Imaging Conference ,November 1997.Google ScholarGoogle Scholar
  12. 12.S.R.Marschner,B.Guenter,and S.Raghupathy.Modeling and rendering for realistic facial animation.In Rendering Techniques ,pages 231 -242.Springer Wien New York,2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. 13.F.I.Parke and K.Waters.Computer Facial Animation . AKPeters,Wellesley,Massachusetts,1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. 14.F.Pighin,J.Hecker,D.Lischinski,R.Szeliski,and D.H.Salesin. Synthesizing realistic facial expressions from photographs.In Computer Graphics,Annual Conference Series ,pages 75 -84. Siggraph,July 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. 15.T.Riklin-Raviv and A.Shashua.The quotient image:Class based re-rendering and recongnition withvarying illuminations. In IEEE Conference on Computer Vision and Pattern Recognition ,pages 566 -571,June 1999.Google ScholarGoogle Scholar
  16. 16.S.M.Seize and C.R.Dyer.View morphing.In Computer Graphics ,pages 21 -30.Siggraph,August 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. 17.A.Stoschek.Image-based re-rendering of faces for continuous pose and illumination directions.In IEEE Conference on Computer Vision and Pattern Recognition ,pages 582 -587,2000.Google ScholarGoogle Scholar
  18. 18.D.Terzopoulos and K.Waters.Physically-based facial modeling and animation.Journal of Visualization and Computer Animation ,1(4):73 -80,March1990.Google ScholarGoogle ScholarCross RefCross Ref
  19. 19.K.Waters.A muscle model for animating three-dimensional facial expression.Computer Graphics ,22(4):17 -24,1987. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. 20.L.Williams.Performace-driven facial animation.In Computer Graphics ,pages 235 -242.Siggraph,August 1990. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. 21.G.Wolberg.Digital Image Warping .IEEE Computer Society Press,1990. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Expressive expression mapping with ratio images

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Conferences
            SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques
            August 2001
            600 pages
            ISBN:158113374X
            DOI:10.1145/383259

            Copyright © 2001 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 1 August 2001

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • Article

            Acceptance Rates

            SIGGRAPH '01 Paper Acceptance Rate65of300submissions,22%Overall Acceptance Rate1,822of8,601submissions,21%

            Upcoming Conference

            SIGGRAPH '24

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader