Evaluating medical aesthetics treatments through evolved age-estimation models

Estimating a person's age from a facial image is a challenging problem with clinical applications. Several medical aesthetics treatments have been developed that alter the skin texture and other facial features, with the goal of potentially improving patient's appearance and perceived age. In this paper, this effect was evaluated using evolutionary neural networks with uncertainty estimation. First, a realistic dataset was obtained from clinical studies that makes it possible to estimate age more reliably than e.g. datasets of celebrity images. Second, a neuroevolution approach was developed that customizes the architecture, learning, and data augmentation hyperparameters and the loss function to this task. Using state-of-the-art computer vision architectures as a starting point, evolution improved their original accuracy significantly, eventually outperforming the best human optimizations in this task. Third, the reliability of the age predictions was estimated using RIO, a Gaussian-Process-based uncertainty model. Evaluation on a real-world Botox treatment dataset shows that the treatment has a quantifiable result: The patients' estimated age is reduced significantly compared to placebo treatments. The study thus shows how AI can be harnessed in a new role: To provide an objective quantitative measure of a subjective perception, in this case the proposed effectiveness of medical aesthetics treatments.

[1]  Yong Wang,et al.  EmotionCues: Emotion-Oriented Visual Summarization of Classroom Videos , 2020, IEEE Transactions on Visualization and Computer Graphics.

[2]  Ateeq Ur Rehman,et al.  Deep Learning-Based Drivers Emotion Classification System in Time Series Data for Remote Applications , 2020, Remote. Sens..

[3]  Risto Miikkulainen,et al.  Optimizing loss functions through multi-variate taylor polynomial parameterization , 2020, GECCO.

[4]  Luc Van Gool,et al.  Deep Expectation of Real and Apparent Age from a Single Image Without Facial Landmarks , 2016, International Journal of Computer Vision.

[5]  Frank Hutter,et al.  Neural Architecture Search: A Survey , 2018, J. Mach. Learn. Res..

[6]  Risto Miikkulainen,et al.  Improved Training Speed, Accuracy, and Data Utilization Through Loss Function Optimization , 2019, 2020 IEEE Congress on Evolutionary Computation (CEC).

[7]  Quoc V. Le,et al.  The Evolved Transformer , 2019, ICML.

[8]  Mei Wang,et al.  Deep Face Recognition: A Survey , 2018, Neurocomputing.

[9]  Quoc V. Le,et al.  AutoML-Zero: Evolving Machine Learning Algorithms From Scratch , 2020, ICML.

[10]  G. Hole,et al.  The role of spatial and surface cues in the age-processing of unfamiliar faces , 2000 .

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Andrew Y. Ng,et al.  CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning , 2017, ArXiv.

[13]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[14]  Shan Li,et al.  Deep Facial Expression Recognition: A Survey , 2018, IEEE Transactions on Affective Computing.

[15]  A. Abelsson,et al.  Ethics and aesthetics in injection treatments with Botox and Filler , 2020, Journal of women & aging.

[16]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  S. Arsiwala Trends for Facial Injectable Therapies in Medical Aesthetics , 2018, Journal of cutaneous and aesthetic surgery.

[18]  A. Klassen,et al.  Measuring patient-reported outcomes in facial aesthetic patients: development of the FACE-Q. , 2010, Facial plastic surgery : FPS.

[19]  Jaehoon Lee,et al.  Deep Neural Networks as Gaussian Processes , 2017, ICLR.

[20]  James Hensman,et al.  Scalable Variational Gaussian Process Classification , 2014, AISTATS.

[21]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[22]  Alok Aggarwal,et al.  Regularized Evolution for Image Classifier Architecture Search , 2018, AAAI.

[23]  Elliot Meyerson,et al.  Pseudo-task Augmentation: From Deep Multitask Learning to Intratask Sharing - and Back , 2018, ICML.

[24]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[25]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Elliot Meyerson,et al.  Quantifying Point-Prediction Uncertainty in Neural Networks via Residual Estimation with an I/O Kernel , 2019, ICLR.

[27]  Charles Blundell,et al.  Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles , 2016, NIPS.

[28]  Quoc V. Le,et al.  Do Better ImageNet Models Transfer Better? , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  D. Perrett,et al.  Perception of age in adult Caucasian male faces: computer graphic manipulation of shape and colour information , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[30]  Yee Whye Teh,et al.  Attentive Neural Processes , 2019, ICLR.

[31]  R. Miikkulainen,et al.  Evolutionary optimization of deep learning activation functions , 2020, GECCO.

[32]  Serge Brédart,et al.  An own-age bias in age estimation of faces , 2011, CogSci.

[33]  Patrik Sörqvist,et al.  Effects of training on age estimation , 2007 .

[34]  Elliot Meyerson,et al.  Evolutionary neural AutoML for deep learning , 2019, GECCO.

[35]  Risto Miikkulainen,et al.  Regularized evolutionary population-based training , 2020, GECCO.

[36]  Natalie C. Ebner,et al.  Let me guess how old you are: effects of age, gender, and facial expression on perceptions of age. , 2012, Psychology and aging.

[37]  Yee Whye Teh,et al.  Conditional Neural Processes , 2018, ICML.

[38]  Andrew Gordon Wilson,et al.  Averaging Weights Leads to Wider Optima and Better Generalization , 2018, UAI.

[39]  Fabio Tozeto Ramos,et al.  Malicious Software Classification Using Transfer Learning of ResNet-50 Deep Neural Network , 2017, 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA).

[40]  Elliot Meyerson,et al.  Evolving Deep Neural Networks , 2017, Artificial Intelligence in the Age of Neural Networks and Brain Computing.

[41]  Timo Aila,et al.  A Style-Based Generator Architecture for Generative Adversarial Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Vijay Vasudevan,et al.  Learning Transferable Architectures for Scalable Image Recognition , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[43]  Pi-Cheng Hsiu,et al.  SSR-Net: A Compact Soft Stagewise Regression Network for Age Estimation , 2018, IJCAI.

[44]  Haiwei Wang,et al.  A Fatigue Driving Detection Algorithm Based on Facial Motion Information Entropy , 2020 .

[45]  Geoffrey E. Hinton,et al.  Bayesian Learning for Neural Networks , 1995 .

[46]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[47]  Graham W. Taylor,et al.  Improved Regularization of Convolutional Neural Networks with Cutout , 2017, ArXiv.

[48]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[49]  Stefan J Cano,et al.  A Systematic Review of Patient-Reported Outcome Measures after Facial Cosmetic Surgery and/or Nonsurgical Facial Rejuvenation , 2009, Plastic and reconstructive surgery.

[50]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[51]  David White,et al.  Two sources of bias explain errors in facial age estimation , 2018, Royal Society Open Science.