A data-driven appearance model for human fatigue

ABSTRACT

Humans become visibly tired during physical activity. After a set of squats, jumping jacks or walking up a flight of stairs, individuals start to pant, sweat, loose their balance, and flush. Simulating these physiological changes due to exertion and exhaustion on an animated character greatly enhances a motion's realism. These fatigue factors depend on the mechanical, physical, and biochemical function states of the human body. The difficulty of simulating fatigue for character animation is due in part to the complex anatomy of the human body. We present a multi-modal capturing technique for acquiring synchronized biosignal data and motion capture data to enhance character animation. The fatigue model utilizes an anatomically derived model of the human body that includes a torso, organs, face, and rigged body. This model is then driven by biosignal output. Our animations show the wide range of exhaustion behaviors synthesized from real biological data output. We demonstrate the fatigue model by augmenting standard motion capture with exhaustion effects to produce more realistic appearance changes during three exercise examples. We compare the fatigue model with both simple procedural methods and a dense marker set data capture of exercise motions.

References

1. {ACP02} Allen B., Curless B., Popović Z.: Articulated body deformation from range scan data. In ACM SIGGRAPH 2002 Papers (New York, NY, USA, 2002), SIGGRAPH '02, ACM, pp. 612--619.
2. {BHPS10} Bradley D., Heidrich W., Popa T., Sheffer A.: High resolution passive facial performance capture. In ACM SIGGRAPH 2010 papers (New York, NY, USA, 2010), SIGGRAPH '10, ACM, pp. 41:1--41:10.
3. {DCFN06} Deng Z., Chiang P.-Y., Fox P., Neumann U.: Animating blendshape faces by cross-mapping motion capture data. In Proceedings of the 2006 symposium on Interactive 3D graphics and games (New York, NY, USA, 2006), I3D '06, ACM, pp. 43--48.
4. {Dil09} Dilorenzo P. C.: Breathing, laughing, sneezing, coughing: model and control of an anatomically inspired, physically-based human torso simulation. PhD thesis, University of California, Riverside, USA, 2009. AAI3350078.
5. {DZS08} DiLorenzo P. C., Zordan V. B., Sanders B. L.: Laughing out loud: control for modeling anatomically inspired laughter using audio. In ACM SIGGRAPH Asia 2008 papers (New York, NY, USA, 2008), SIGGRAPH Asia '08, ACM, pp. 125:1--125:8.
6. {INN07} Igarashi T., Nishino K., Nayar S. K.: The appearance of human skin: A survey. Found. Trends. Comput. Graph. Vis. 3 (January 2007), 1--95.
7. {JSB*10} Jimenez J., Scully T., Barbosa N., Donner C., Alvarez X., Vieira T., Matts P., Orvalho V., Gutierrez D., Weyrich T.: A practical appearance model for dynamic facial color. In ACM SIGGRAPH Asia 2010 papers (New York, NY, USA, 2010), SIGGRAPH ASIA '10, ACM, pp. 141:1--141:10.
8. {KHYS02} Kähler K., Haber J., Yamauchi H., Seidel H.-P.: Head shop: generating animated head models with anatomical structure. In Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation (New York, NY, USA, 2002), SCA '02, ACM, pp. 55--63.
9. {KMP97} Kaye J., Metaxas D. N., Primiano Jr. F. P.: A 3d virtual environment for modeling mechanical cardiopulmonary interactions. In Proceedings of the First Joint Conference on Computer Vision, Virtual Reality and Robotics in Medicine and Medial Robotics and Computer-Assisted Surgery (London, UK, 1997), CVRMed-MRCAS '97, Springer-Verlag, pp. 389--398.
10. {KMT02} Kalra P., Magnenat-thalmann N.: Modelling of vascular expressions in facial animation. In Proceedings of Computer Animation (2002), pp. 50--58.
11. {LM88} Lamb D., Murry R.: Perspectives in Exercise Science and Sports Medicine. Benchmark Press, 1988.
12. {LT06} Lee S.-H., Terzopoulos D.: Heads up!: biomechanical modeling and neuromuscular control of the neck. In ACM SIGGRAPH 2006 Papers (New York, NY, USA, 2006), SIGGRAPH '06, ACM, pp. 1188--1198.
13. {MAP*82} Mellander S., Andersson, P. O. A., L. E., Hellstrand P.: Neural beta-adrenergic dilatation of the facial vein in man: possible mechanism in emotional blushing. In Acta Physiologica Scandinavica (1982), pp. 393--399.
14. {Mar98} Marieb E.: Human Anatomy and Physiology. Addision Wesley, 1998.
15. {MB91} Monheit G., Badler N. I.: A kinematic model of the human spine and torso. IEEE Comput. Graph. Appl. 11 (March 1991), 29--38.
16. {Met97} Metaxas D. N.: Physics-Based Deformable Models. Kluwer Academic Publishers, 1997.
17. {MG09} Melo C. M., Gratch J.: Expression of emotions using wrinkles, blushing, sweating and tears. In Proceedings of the 9th International Conference on Intelligent Virtual Agents (Berlin, Heidelberg, 2009), IVA '09, Springer-Verlag, pp. 188--200.
18. {Min93} Mines A.: Respiratory Physiology. Raven Press, 1993.
19. {MTCS08} Magnenat-Thalmann N., Charbonnier C., Schmid J.: Multimedia application to the simulation of human musculoskeletal system: A visual lower limb model from multimodal captured data. In Multimedia Signal Processing, 2008 IEEE 10th Workshop on (oct. 2008), pp. 520--525.
20. {PB81} Platt S. M., Badler N. I.: Animating facial expressions. In Proceedings of the 8th annual conference on Computer graphics and interactive techniques (New York, NY, USA, 1981), SIGGRAPH '81, ACM, pp. 245--252.
21. {PBP97} Promayon E., Baconnier P., Puech C.: Physically-based model for simulating the human trunk respiration movements. In Proceedings of the First Joint Conference on Computer Vision, Virtual Reality and Robotics in Medicine and Medial Robotics and Computer-Assisted Surgery (London, UK, 1997), CVRMed-MRCAS '97, Springer-Verlag, pp. 379--388.
22. {PH06} Park S. I., Hodgins J. K.: Capturing and animating skin deformation in human motion. ACM Trans. Graph. 25 (July 2006), 881--889.
23. {PH08} Park S. I., Hodgins J. K.: Data-driven modeling of skin and muscle deformation. In ACM SIGGRAPH 2008 papers (New York, NY, USA, 2008), SIGGRAPH '08, ACM, pp. 96:1--96:6.
24. {PT57} Price Thomas I. K.: Relationship between sweat gland activity and electrical resistance of the skin. In Journal of Applied Physiology (1957), pp. 578--586.
25. {Sag06} Sagar1 M.: Facial performance capture and expressive translation for king kong. In ACM SIGGRAPH 2006 Courses (New York, NY, USA, 2006), SIGGRAPH '06, ACM.
26. {SCCH09} Shiratori T., Coley B., Cham R., Hodgins J. K.: Simulating balance recovery responses to trips based on biomechanical principles. In Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (New York, NY, USA, 2009), SCA '09, ACM, pp. 37--46.
27. {SDZB08} Sanders B., DiLorenzo P., Zordan V., Bakal D.: Toward anatomical simulation for breath retraining in mind/body medicine. In Workshop on 3D Physiological Human (2008).
28. {SMP03} Sand P., McMillan L., Popović J.: Continuous capture of skin deformation. In ACM SIGGRAPH 2003 Papers (New York, NY, USA, 2003), SIGGRAPH '03, ACM, pp. 578--586.
29. {SNF05} Sifakis E., Neverov I., Fedkiw R.: Automatic determination of facial muscle activations from sparse motion capture marker data. In ACM SIGGRAPH 2005 Papers (New York, NY, USA, 2005), SIGGRAPH '05, ACM, pp. 417--425.
30. {TLX10} Tengyu Z., Lifeng L., Xiaojun S.: Design and application of gait analysis system for prosthesis wearers. In Proceedings of the 4th International Convention on Rehabilitation Engineering & Assistive Technology (Kaki Bukit TechPark II" Singapore, 2010), iCREATe '10, Singapore Therapeutic, Assistive & Rehabilitative Technologies (START) Centre, pp. 53:1--53:3.
31. {vic11} Vicon motion systems, May 2011.
32. {Wat87} Waters K.: A muscle model for animation three-dimensional facial expression. In Proceedings of the 14th annual conference on Computer graphics and interactive techniques (New York, NY, USA, 1987), SIGGRAPH '87, ACM, pp. 17--24.
33. {Wes04} West J.: Respiratory Physiology: the essentials. Lippincott Williams & Wilkins, 2004.
34. {WMP*06} Weyrich T., Matusik W., Pfister H., Bickel B., Donner C., Tu C., McAndless J., Lee J., Ngan A., Jensen H. W., Gross M.: Analysis of human faces using a measurement-based skin reflectance model. In ACM SIGGRAPH 2006 Papers (New York, NY, USA, 2006), SIGGRAPH '06, ACM, pp. 1013--1024.
35. {YW07} Yamada T., Watanabe T.: Virtual facial image synthesis with facial color enhancement and expression under emotional change of anger. In 16th IEEE International Conference on Robot & Human Interactive Communication, pp. 49--54.
36. {ZCCD06} Zordan V. B., Celly B., Chiu B., DiLorenzo P. C.: Breathe easy: model and control of human respiration for computer animation. Graphical Models 68 (March 2006), 113--132.

Index Terms

• Computing methodologies

  • Computer graphics

    • Animation