The Virtual Caliper: Rapid Creation of Metrically Accurate Avatars from 3D Measurements

Creating metrically accurate avatars is important for many applications such as virtual clothing try-on, ergonomics, medicine, immersive social media, telepresence, and gaming. Creating avatars that precisely represent a particular individual is challenging however, due to the need for expensive 3D scanners, privacy issues with photographs or videos, and difficulty in making accurate tailoring measurements. We overcome these challenges by creating “The Virtual Caliper”, which uses VR game controllers to make simple measurements. First, we establish what body measurements users can reliably make on their own body. We find several distance measurements to be good candidates and then verify that these are linearly related to 3D body shape as represented by the SMPL body model. The Virtual Caliper enables novice users to accurately measure themselves and create an avatar with their own body shape. We evaluate the metric accuracy relative to ground truth 3D body scan data, compare the method quantitatively to other avatar creation tools, and perform extensive perceptual studies. We also provide a software application to the community that enables novices to rapidly create avatars in fewer than five minutes. Not only is our approach more rapid than existing methods, it exports a metrically accurate 3D avatar model that is rigged and skinned.

[1]  Hans-Peter Seidel,et al.  Estimating body shape of dressed humans , 2009, Comput. Graph..

[2]  Marc Erich Latoschik,et al.  Fast generation of realistic virtual humans , 2017, VRST.

[3]  Ligang Liu,et al.  Scanning 3D Full Human Bodies Using Kinects , 2012, IEEE Transactions on Visualization and Computer Graphics.

[4]  Michael J. Black,et al.  Investigating Body Image Disturbance in Anorexia Nervosa Using Novel Biometric Figure Rating Scales: A Pilot Study , 2017, European eating disorders review : the journal of the Eating Disorders Association.

[5]  Michael J. Black,et al.  MoSh: motion and shape capture from sparse markers , 2014, ACM Trans. Graph..

[6]  Yunhe Pan,et al.  Research on virtual human in ergonomic simulation , 2007, Comput. Ind. Eng..

[7]  Jaroslav Krivánek,et al.  Reconstructing personalized anatomical models for physics-based body animation , 2016, ACM Trans. Graph..

[8]  Nadia Magnenat-Thalmann,et al.  An example-based approach to human body manipulation , 2004, Graph. Model..

[9]  Michael J. Black,et al.  Estimating human shape and pose from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Nadia Magnenat-Thalmann,et al.  Made-to-Measure Technologies for an Online Clothing Store , 2003, IEEE Computer Graphics and Applications.

[11]  Jonathan T. Barron,et al.  3D self-portraits , 2013, ACM Trans. Graph..

[12]  Chang Shu,et al.  Estimating 3D human shapes from measurements , 2012, Machine Vision and Applications.

[13]  Chang Shu,et al.  Three-dimensional human shape inference from silhouettes: reconstruction and validation , 2011, Machine Vision and Applications.

[14]  Matthew Stone,et al.  An anthropometric face model using variational techniques , 1998, SIGGRAPH.

[15]  Unite the People : Closing the loop between 3 D and 2 D Human Representations Supplementary Material , 2017 .

[16]  Yun-Ja Nam,et al.  Comparative analysis of 3D body scan measurements and manual measurements of size Korea adult females , 2010 .

[17]  Michael J. Black,et al.  Lie Bodies: A Manifold Representation of 3D Human Shape , 2012, ECCV.

[18]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH 2005.

[19]  Pan Yunhe,et al.  Research on virtual human in ergonomic simulation , 2007 .

[20]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[21]  Michael J. Black,et al.  Detailed Human Shape and Pose from Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[23]  Henry Fuchs,et al.  Immersive 3D Telepresence , 2014, Computer.

[24]  Bodo Rosenhahn,et al.  Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUs , 2017, Comput. Graph. Forum.

[25]  Kathleen M Robinette,et al.  Precision of the CAESAR scan-extracted measurements. , 2006, Applied ergonomics.

[26]  Ladislav Kavan,et al.  Computational bodybuilding , 2015, ACM Trans. Graph..

[27]  J. Kilimann,et al.  A Fast Avatar Calibration Method for Virtual Environments Using Six 6-DOF Trackers , 2018, 2018 IEEE 1st Workshop on Animation in Virtual and Augmented Environments (ANIVAE).

[28]  H. C. Dijkerman,et al.  A Virtual Reality Full Body Illusion Improves Body Image Disturbance in Anorexia Nervosa , 2016, PloS one.

[29]  Robert A. Walker,et al.  Anthropometric Survey of U.S. Army Personnel: Summary Statistics, Interim Report for 1988 , 1989 .

[30]  P. Haggard,et al.  Body image distortions in healthy adults. , 2013, Acta psychologica.

[31]  Michael J. Black,et al.  Detailed Full-Body Reconstructions of Moving People from Monocular RGB-D Sequences , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[32]  Li Li,et al.  The Accuracy and Precision of Position and Orientation Tracking in the HTC Vive Virtual Reality System for Scientific Research , 2017, i-Perception.

[33]  François Faure,et al.  Anatomical mirroring: real-time user-specific anatomy in motion using a commodity depth camera , 2016, MIG.

[34]  Karl F. MacDorman,et al.  The Uncanny Valley [From the Field] , 2012, IEEE Robotics Autom. Mag..

[35]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[36]  Michael J. Black,et al.  SMPL: A Skinned Multi-Person Linear Model , 2015, ACM Trans. Graph..

[37]  D. Cohen-Or,et al.  Parametric reshaping of human bodies in images , 2010, ACM Trans. Graph..

[38]  Gérard G. Medioni,et al.  Rapid avatar capture and simulation using commodity depth sensors , 2014, Comput. Animat. Virtual Worlds.

[39]  Kathleen M. Robinette,et al.  Civilian American and European Surface Anthropometry Resource (CAESAR), Final Report. Volume 1. Summary , 2002 .

[40]  Hans-Peter Seidel,et al.  MovieReshape: tracking and reshaping of humans in videos , 2010, ACM Trans. Graph..

[41]  Sebastian Thrun,et al.  Video-based reconstruction of animatable human characters , 2010, ACM Trans. Graph..

[42]  Wei Sun,et al.  Virtual people: capturing human models to populate virtual worlds , 1999, Proceedings Computer Animation 1999.

[43]  Norman I. Badler,et al.  Virtual humans for animation, ergonomics, and simulation , 1997, Proceedings IEEE Nonrigid and Articulated Motion Workshop.

[44]  H J Krzywicki,et al.  Human body density and fat of an adult male population as measured by water displacement. , 1967, The American journal of clinical nutrition.

[45]  Peter V. Gehler,et al.  Keep It SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Image , 2016, ECCV.

[46]  T. Popa,et al.  TOWARDS NEXT GENERATION 3 D TELECONFERENCING SYSTEMS , 2012 .

[47]  Charlie C. L. Wang,et al.  Exemplar-based statistical model for semantic parametric design of human body , 2010, Comput. Ind..

[48]  Qiaosong Wang,et al.  Im2Fit: Fast 3D Model Fitting and Anthropometrics using Single Consumer Depth Camera and Synthetic Data , 2014, 3D Image Processing, Measurement , and Applications.

[49]  Markus H. Gross,et al.  Shape from Selfies: Human Body Shape Estimation Using CCA Regression Forests , 2016, ECCV.

[50]  Hans-Peter Seidel,et al.  A Statistical Model of Human Pose and Body Shape , 2009, Comput. Graph. Forum.

[51]  Verónica Orvalho,et al.  Achieving Participant Acceptance of their Avatars , 2014, PRESENCE: Teleoperators and Virtual Environments.