skip to main content
10.5555/1218064.1218084acmconferencesArticle/Chapter ViewAbstractPublication PagesscaConference Proceedingsconference-collections
Article

Learning a correlated model of identity and pose-dependent body shape variation for real-time synthesis

Published: 02 September 2006 Publication History

Abstract

We present a method for learning a model of human body shape variation from a corpus of 3D range scans. Our model is the first to capture both identity-dependent and pose-dependent shape variation in a correlated fashion, enabling creation of a variety of virtual human characters with realistic and non-linear body deformations that are customized to the individual. Our learning method is robust to irregular sampling in pose-space and identity-space, and also to missing surface data in the examples. Our synthesized character models are based on standard skinning techniques and can be rendered in real time.

References

[1]
{ACP02} Allen B., Curless B., Popović Z.: Articulated body deformation from range scan data. ACM Transactions on Graphics (ACM SIGGRAPH 2002) 21, 3 (2002), 612--619.]]
[2]
{ACP03} Allen B., Curless B., Popović Z.: The space of human body shapes: reconstruction and parameterization from range scans. ACM Transactions on Graphics (ACM SIGGRAPH 2003) 22, 3 (2003), 587--594.]]
[3]
{ASK*05} Anguelov D., Srinivasan P., Koller D., Thrun S., Rodgers J., Davis J.: SCAPE: shape completion and animation of people. ACM Transactions on Graphics (ACM SIGGRAPH 2005) 24, 3 (2005), 408--416.]]
[4]
{BV99} Blanz V., Vetter T.: A morphable model for the synthesis of 3D faces. In Proceedings of ACM SIGGRAPH 99 (New York, 1999), Rockwood A., (Ed.), Computer Graphics Proceedings, Annual Conference Series, ACM Press/Addison-Wesley Publishing Co., pp. 187--194.]]
[5]
{DLR77} Dempster A. P., Laird N. M., Rubin D. B.: Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society (Series B) 39, 1 (1977), 1--38.]]
[6]
{JT05} James D. L., Twigg C. D.: Skinning mesh animations. ACM Transactions on Graphics (SIGGRAPH 2005) 24, 3 (Aug. 2005).]]
[7]
{KCVS98} Kobbelt L., Campagna S., Vorsatz J., Seidel H.-P.: Interactive multi-resolution modeling on arbitrary meshes. In Proceedings of ACM SIGGRAPH 98 (New York, 1998), ACM Press, pp. 105--114.]]
[8]
{KJP02} Kry P. G., James D. L., Pai D. K.: Eigenskin: real time large deformation character skinning in hardware. In Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation (2002), ACM Press, pp. 153--159.]]
[9]
{Kv05} Kavan L., Žára J.: Spherical blend skinning: a real-time deformation of articulated models. In SI3D '05: Proceedings of the 2005 symposium on Interactive 3D graphics and games (New York, NY, USA, 2005), ACM Press, pp. 9--16.]]
[10]
{LCF00} Lewis J. P., Cordner M., Fong N.: Pose space deformations: A unified approach to shape interpolation and skeleton-driven deformation. In Proceedings of ACM SIGGRAPH 2000 (2000), Akeley K., (Ed.), Computer Graphics Proceedings, Annual Conference Series, ACM Press / ACM SIGGRAPH / Addison Wesley Longman, pp. 165--172.]]
[11]
{MG03} Mohr A., Gleicher M.: Building efficient, accurate character skins from examples. ACM Transactions on Graphics (ACM SIGGRAPH 2003) (2003).]]
[12]
{MTT91} Magnenat-Thalmann N., Thalmann D.: Human body deformations using joint-dependent local operators and finite-element theory. 243--262.]]
[13]
{NH98} Neal R. M., Hinton G. E.: A new view of the EM algorithm that justifies incremental, sparse and other variants. In Learning in Graphical Models, Jordan M. I., (Ed.). Kluwer Academic Publishers, 1998, pp. 355--368.]]
[14]
{RL99} Rouet C., Lewis J.: Method and apparatus for creating lifelike digital representations of computer animated objects by providing corrective enveloping. US Patent 5,883,638, 1999.]]
[15]
{Row98} Roweis S.: EM algorithms for PCA and SPCA. In Advances in Neural Information Processing Systems (1998), Jordan M. I., Kearns M. J., Solla S. A., (Eds.), vol. 10, The MIT Press.]]
[16]
{SCMT03} Seo H., Cordier F., Magnenat-Thalmann N.: Synthesizing body models with parameterized shape modifications. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2003), pp. 120--125.]]
[17]
{SK00} Singh K., Kokkevis E.: Skinning characters using surface-oriented free-form deformations. In Graphics Interface (2000), pp. 35--42.]]
[18]
{SPB*98} Silaghi M.-C., Plänkers R., Boulic R., Fua P., Thalmann D.: Local and global skeleton fitting techniques for optical motion capture. In Proceedings of the International Workshop on Modelling and Motion Capture Techniques for Virtual Environments (CAPTECH-98) (Berlin, Nov. 26--27 1998), Magnenat-Thalmann N., Thalmann D., (Eds.), vol. 1537 of LNAI, Springer, pp. 26--40.]]
[19]
{SPCM97} Scheepers F., Parent R. E., Carlson W. E., May S. F.: Anatomy-based modeling of the human musculature. In SIGGRAPH '97: Proceedings of the 24th annual conference on Computer graphics and interactive techniques (New York, NY, USA, 1997), ACM Press/Addison-Wesley Publishing Co., pp. 163--172.]]
[20]
{SRC01} Sloan P.-P., Rose C., Cohen M. F.: Shape by example. In Proceedings of 2001 Symposium on Interactive 3D Graphics (2001), pp. 135--143.]]
[21]
{TB99} Tipping M. E., Bishop C. M.: Probabilistic principal component analysis. Journal of the Royal Statistical Society, Series B 61, 3 (1999), 611--622.]]
[22]
{TH04} Torresani L., Hertzmann A.: Automatic non-rigid 3D modeling from video. In ECCV (2) (2004), pp. 299--312.]]
[23]
{VBPP05} Vlasic D., Brand M., Pfister H., Popović J.: Face transfer with multilinear models. ACM Transactions on Graphics (ACM SIGGRAPH 2005) 24, 3 (2005), 426--433.]]
[24]
{WP02} Wang X. C., Phillips C.: Multi-weight enveloping: Least-squares approximation techniques for skin animation. In Proceedings of the 2002 ACM SIGGRAPH Symposium on Computer Animation (2002), pp. 129--138.]]
[25]
{ZBLN97} Zhu C., Byrd R. H., Lu P., Nocedal J.: Algorithm 778. L-BFGS-B: Fortran subroutines for Large-Scale bound constrained optimization. ACM Transactions on Mathematical Software 23, 4 (Dec. 1997), 550--560.]]

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SCA '06: Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation
September 2006
370 pages
ISBN:3905673347

Sponsors

Publisher

Eurographics Association

Goslar, Germany

Publication History

Published: 02 September 2006

Check for updates

Qualifiers

  • Article

Conference

SCA06
Sponsor:

Acceptance Rates

Overall Acceptance Rate 183 of 487 submissions, 38%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)14
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media