SMPL: A Skinned Multi-Person Linear Model

We present a learned model of human body shape and pose-dependent shape variation that is more accurate than previous models and is compatible with existing graphics pipelines. Our Skinned Multi-Person Linear model (SMPL) is a skinned vertex-based model that accurately represents a wide variety of body shapes in natural human poses. The parameters of the model are learned from data including the rest pose template, blend weights, pose-dependent blend shapes, identity-dependent blend shapes, and a regressor from vertices to joint locations. Unlike previous models, the pose-dependent blend shapes are a linear function of the elements of the pose rotation matrices. This simple formulation enables training the entire model from a relatively large number of aligned 3D meshes of different people in different poses. We quantitatively evaluate variants of SMPL using linear or dual-quaternion blend skinning and show that both are more accurate than a Blend-SCAPE model trained on the same data. We also extend SMPL to realistically model dynamic soft-tissue deformations. Because it is based on blend skinning, SMPL is compatible with existing rendering engines and we make it available for research purposes.

[1]  Okan Arikan,et al.  Frankenrigs: Building Character Rigs from Multiple Sources , 2011, IEEE Transactions on Visualization and Computer Graphics.

[2]  Hans-Peter Seidel,et al.  Learning skeletons for shape and pose , 2010, I3D '10.

[3]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[4]  Jovan Popovic,et al.  Automatic rigging and animation of 3D characters , 2007, ACM Trans. Graph..

[5]  John P. Lewis,et al.  Real‐Time Weighted Pose‐Space Deformation on the GPU , 2006, Comput. Graph. Forum.

[6]  Hans-Peter Seidel,et al.  Automatic Conversion of Mesh Animations into Skeleton‐based Animations , 2008, Comput. Graph. Forum.

[7]  Carol O'Sullivan,et al.  Automatic linearization of nonlinear skinning , 2009, I3D '09.

[8]  Cary B. Phillips,et al.  Multi-weight enveloping: least-squares approximation techniques for skin animation , 2002, SCA '02.

[9]  Michael J. Black,et al.  Breathing life into shape , 2014, ACM Trans. Graph..

[10]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH '05.

[11]  Kathleen M. Robinette,et al.  Civilian American and European Surface Anthropometry Resource (CAESAR), Final Report. Volume 1. Summary , 2002 .

[12]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[13]  Michael Gleicher,et al.  Building efficient, accurate character skins from examples , 2003, ACM Trans. Graph..

[14]  Olga Sorkine-Hornung,et al.  Context‐Aware Skeletal Shape Deformation , 2007, Comput. Graph. Forum.

[15]  Michael J. Black,et al.  Lie Bodies: A Manifold Representation of 3D Human Shape , 2012, ECCV.

[16]  Aaron Hertzmann,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2006) Learning a Correlated Model of Identity and Pose-dependent Body Shape Variation for Real-time Synthesis , 2022 .

[17]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH 2005.

[18]  Kari Pulli,et al.  Real-time enveloping with rotational regression , 2007, ACM Trans. Graph..

[19]  Michael J. Black,et al.  FAUST: Dataset and Evaluation for 3D Mesh Registration , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Jirí Zára,et al.  Spherical blend skinning: a real-time deformation of articulated models , 2005, I3D '05.

[21]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[22]  Michael J. Black,et al.  Coregistration: Simultaneous Alignment and Modeling of Articulated 3D Shape , 2012, ECCV.

[23]  Scott Schaefer,et al.  Example-based skeleton extraction , 2007, Symposium on Geometry Processing.

[24]  Zhigang Deng,et al.  Robust and accurate skeletal rigging from mesh sequences , 2014, ACM Trans. Graph..

[25]  Tsuneya Kurihara,et al.  Modeling deformable human hands from medical images , 2004, SCA '04.

[26]  Doug L. James,et al.  Skinning mesh animations , 2005, ACM Trans. Graph..

[27]  Zicheng Liu,et al.  Tensor-Based Human Body Modeling , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Michael J. Black,et al.  MoSh: motion and shape capture from sparse markers , 2014, ACM Trans. Graph..

[29]  Michael J. Black,et al.  OpenDR: An Approximate Differentiable Renderer , 2014, ECCV.

[30]  Nadia Magnenat-Thalmann,et al.  Synthesizing animatable body models with parameterized shape modifications , 2003, SCA '03.

[31]  Jirí Zára,et al.  Geometric skinning with approximate dual quaternion blending , 2008, TOGS.

[32]  Dinesh K. Pai,et al.  EigenSkin: real time large deformation character skinning in hardware , 2002, SCA '02.

[33]  Zoran Popovic,et al.  Articulated body deformation from range scan data , 2002, SIGGRAPH.

[34]  Michael J. Black,et al.  Dyna: a model of dynamic human shape in motion , 2015, ACM Trans. Graph..

[35]  Hans-Peter Seidel,et al.  A Statistical Model of Human Pose and Body Shape , 2009, Comput. Graph. Forum.

[36]  John P. Lewis,et al.  Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation , 2000, SIGGRAPH.

[37]  Zhigang Deng,et al.  Smooth skinning decomposition with rigid bones , 2012, ACM Trans. Graph..

[38]  James E. Gain,et al.  Animation space: A truly linear framework for character animation , 2006, TOGS.

[39]  Doug L. James,et al.  Skinning mesh animations , 2005, SIGGRAPH 2005.

[40]  Matthias Zwicker,et al.  Range Scan Registration Using Reduced Deformable Models , 2009, Comput. Graph. Forum.