Dyna: a model of dynamic human shape in motion

To look human, digital full-body avatars need to have soft-tissue deformations like those of real people. We learn a model of soft-tissue deformations from examples using a high-resolution 4D capture system and a method that accurately registers a template mesh to sequences of 3D scans. Using over 40,000 scans of ten subjects, we learn how soft-tissue motion causes mesh triangles to deform relative to a base 3D body model. Our Dyna model uses a low-dimensional linear subspace to approximate soft-tissue deformation and relates the subspace coefficients to the changing pose of the body. Dyna uses a second-order auto-regressive model that predicts soft-tissue deformations based on previous deformations, the velocity and acceleration of the body, and the angular velocities and accelerations of the limbs. Dyna also models how deformations vary with a person's body mass index (BMI), producing different deformations for people with different shapes. Dyna realistically represents the dynamics of soft tissue for previously unseen subjects and motions. We provide tools for animators to modify the deformations and apply them to new stylized characters.

[1]  N. Magnenat-Thalmann,et al.  Dynamics kin deformation based on biomechanical modeling , 2012 .

[2]  Marcus A. Magnor,et al.  Sparse localized deformation components , 2013, ACM Trans. Graph..

[3]  Jessica K. Hodgins,et al.  Data-driven modeling of skin and muscle deformation , 2008, ACM Trans. Graph..

[4]  Markus H. Gross,et al.  Rig-space physics , 2012, ACM Trans. Graph..

[5]  Theodore Kim,et al.  Skipping steps in deformable simulation with online model reduction , 2009, ACM Trans. Graph..

[6]  Jessica K. Hodgins,et al.  Stable spaces for real-time clothing , 2010, ACM Trans. Graph..

[7]  Craig Gotsman,et al.  Compression of soft-body animation sequences , 2004, Comput. Graph..

[8]  Demetri Terzopoulos,et al.  Physically-based facial modelling, analysis, and animation , 1990, Comput. Animat. Virtual Worlds.

[9]  Jovan Popovic,et al.  Deformation transfer for triangle meshes , 2004, ACM Trans. Graph..

[10]  Marc Alexa,et al.  Representing Animations by Principal Components , 2000, Comput. Graph. Forum.

[11]  Adrian Hilton,et al.  Surface Capture for Performance-Based Animation , 2007, IEEE Computer Graphics and Applications.

[12]  Dinesh K. Pai,et al.  DyRT: dynamic response textures for real time deformation simulation with graphics hardware , 2002, SIGGRAPH.

[13]  Karan Singh,et al.  Outside-in anatomy based character rigging , 2005, SCA '05.

[14]  Edilson de Aguiar,et al.  Representing mesh-based character animations , 2014, Comput. Graph..

[15]  Ronald Fedkiw,et al.  Creating and simulating skeletal muscle from the visible human data set , 2005, IEEE Transactions on Visualization and Computer Graphics.

[16]  Michael J. Black,et al.  DRAPE: DRessing Any PErson , 2012, ACM Trans. Graph..

[17]  Dinesh K. Pai,et al.  Active volumetric musculoskeletal systems , 2014, ACM Trans. Graph..

[18]  Michael J. Black,et al.  MoSh: motion and shape capture from sparse markers , 2014, ACM Trans. Graph..

[19]  Walter Maurel,et al.  Biomechanical Models for Soft Tissue Simulation , 2003, Esprit Basic Research Series.

[20]  M. Otaduy,et al.  Capture and modeling of non-linear heterogeneous soft tissue , 2009, ACM Trans. Graph..

[21]  Steve Capell,et al.  Interactive skeleton-driven dynamic deformations , 2002, ACM Trans. Graph..

[22]  Michael J. Black,et al.  Breathing life into shape , 2014, ACM Trans. Graph..

[23]  Jane Wilhelms,et al.  Anatomically based modeling , 1997, SIGGRAPH.

[24]  Daniel Thalmann,et al.  Interactive modeling of the human musculature , 2001, Proceedings Computer Animation 2001. Fourteenth Conference on Computer Animation (Cat. No.01TH8596).

[25]  Dimitris N. Metaxas,et al.  Shape and Nonrigid Motion Estimation Through Physics-Based Synthesis , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Zoran Popovic,et al.  Articulated body deformation from range scan data , 2002, SIGGRAPH.

[27]  Eftychios Sifakis,et al.  Comprehensive biomechanical modeling and simulation of the upper body , 2009, TOGS.

[28]  Marcus A. Magnor,et al.  Capture and Statistical Modeling of Arm‐Muscle Deformations , 2013, Comput. Graph. Forum.

[29]  Doug L. James,et al.  Physics-Based Character Skinning Using Multidomain Subspace Deformations , 2011, IEEE Transactions on Visualization and Computer Graphics.

[30]  Kun Zhou,et al.  Example-based dynamic skinning in real time , 2008, ACM Trans. Graph..

[31]  Richard E. Parent,et al.  Layered construction for deformable animated characters , 1989, SIGGRAPH.

[32]  Dinesh K. Pai,et al.  EigenSkin: real time large deformation character skinning in hardware , 2002, SCA '02.

[33]  Ronald Fedkiw,et al.  Automatic determination of facial muscle activations from sparse motion capture marker data , 2005, SIGGRAPH '05.

[34]  Hans-Peter Seidel,et al.  A Statistical Model of Human Pose and Body Shape , 2009, Comput. Graph. Forum.

[35]  Hans-Peter Seidel,et al.  Performance capture from sparse multi-view video , 2008, ACM Trans. Graph..

[36]  Wayne E. Carlson,et al.  Anatomy-based modeling of the human musculature , 1997, SIGGRAPH.

[37]  Bruno Arnaldi,et al.  Dynamic skinning: adding real-time dynamic effects to an existing character animation , 2005, SCCG '05.

[38]  Michael J. Black,et al.  FAUST: Dataset and Evaluation for 3D Mesh Registration , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Michael J. Black,et al.  Coregistration: Simultaneous Alignment and Modeling of Articulated 3D Shape , 2012, ECCV.

[40]  Zicheng Liu,et al.  Tensor-Based Human Body Modeling , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH '05.

[42]  Kathleen M. Robinette,et al.  Civilian American and European Surface Anthropometry Resource (CAESAR), Final Report. Volume 1. Summary , 2002 .

[43]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[44]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[45]  Steve Capell,et al.  Physically based rigging for deformable characters , 2005, SCA '05.

[46]  John P. Lewis,et al.  Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation , 2000, SIGGRAPH.

[47]  Jessica K. Hodgins,et al.  Capturing and animating skin deformation in human motion , 2006, SIGGRAPH '06.