Designing Engaging Games Using Bayesian Optimization

We use Bayesian optimization methods to design games that maximize user engagement. Participants are paid to try a game for several minutes, at which point they can quit or continue to play voluntarily with no further compensation. Engagement is measured by player persistence, projections of how long others will play, and a post-game survey. Using Gaussian process surrogate-based optimization, we conduct efficient experiments to identify game design characteristics---specifically those influencing difficulty---that lead to maximal engagement. We study two games requiring trajectory planning, the difficulty of each is determined by a three-dimensional continuous design space. Two of the design dimensions manipulate the game in user-transparent manner (e.g., the spacing of obstacles), the third in a subtle and possibly covert manner (incremental trajectory corrections). Converging results indicate that overt difficulty manipulations are effective in modulating engagement only when combined with the covert manipulation, suggesting the critical role of a user's self-perception of competence.

[1]  Paul A. Cairns,et al.  The Placebo Effect in Digital Games: Phantom Perception of Adaptive Artificial Intelligence , 2015, CHI PLAY.

[2]  Peter Brusilovsky,et al.  Adaptive educational systems on the World Wide Web , 1998 .

[3]  Christoph Klimmt,et al.  Experimental Evidence for Suspense as Determinant of Video Game Enjoyment , 2009, Cyberpsychology Behav. Soc. Netw..

[4]  Z. Popovic,et al.  Crystal structure of a monomeric retroviral protease solved by protein folding game players , 2011, Nature Structural &Molecular Biology.

[5]  Harold Pashler,et al.  Optimizing Instructional Policies , 2013, NIPS.

[6]  Mark O. Riedl,et al.  Automatic playtesting for game parameter tuning via active learning , 2019, FDG.

[7]  Heikki Lyytinen,et al.  A Bayesian-optimal principle for learner-friendly adaptation in learning games , 2010 .

[8]  Kenneth R. Koedinger,et al.  Interface Design Optimization as a Multi-Armed Bandit Problem , 2016, CHI.

[9]  P. Shah,et al.  Differential effect of motivational features on training improvements in school-based cognitive training , 2014, Front. Hum. Neurosci..

[10]  Jennifer A. Fredricks,et al.  School Engagement: Potential of the Concept, State of the Evidence , 2004 .

[11]  Derek Ruths,et al.  An Analysis of Exercising Behavior in Online Populations , 2015, ICWSM.

[12]  Jeffrey N. Rouder,et al.  A hierarchical model for estimating response time distributions , 2005, Psychonomic bulletin & review.

[13]  Michael C. Mozer,et al.  Improving Human-Machine Cooperative Classification Via Cognitive Theories of Similarity , 2017, Cogn. Sci..

[14]  Kay Berkling,et al.  Gamification of a Software Engineering course and a detailed analysis of the factors that lead to it's failure , 2013, 2013 International Conference on Interactive Collaborative Learning (ICL).

[15]  Elaine Toms,et al.  The development and evaluation of a survey to measure user engagement , 2010, J. Assoc. Inf. Sci. Technol..

[16]  Christian Bauckhage,et al.  The Playtime Principle: Large-scale cross-games interest modeling , 2014, 2014 IEEE Conference on Computational Intelligence and Games.

[17]  Adrien Treuille,et al.  Predicting protein structures with a multiplayer online game , 2010, Nature.

[18]  M L Schare,et al.  Effects of the "near miss" and the "big win" on persistence at slot machine gambling. , 2001, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[19]  Joseph E. Beck,et al.  Engagement tracing: using response times to model student disengagement , 2005, AIED.

[20]  Jeanne H. Brockmyer,et al.  The Development of the Game Engagement Questionnaire: A Measure of Engagement in Video Game Playing: Response to Reviews , 2009, Interacting with computers.

[21]  L. Vygotsky Mind in Society: The Development of Higher Psychological Processes: Harvard University Press , 1978 .

[22]  Eric Wiebe,et al.  Measuring Video Game Engagement Through the Cognitive and Affective Dimensions , 2014 .

[23]  Joseph Jay Williams,et al.  Beyond Time-on-Task: The Relationship between Spaced Study and Certification in MOOCs , 2015, J. Learn. Anal..

[24]  Andrew Nealen,et al.  Exploring Game Space Using Survival Analysis , 2015, FDG.

[25]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[26]  Brent E. Harrison,et al.  Analytics-driven dynamic game adaption for player retention in Scrabble , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[27]  Lihong Li,et al.  An Empirical Evaluation of Thompson Sampling , 2011, NIPS.

[28]  Arnav Jhala,et al.  Modeling Player Retention in Madden NFL 11 , 2011, IAAI.

[29]  Zoran Popovic,et al.  Placing a value on aesthetics in online casual games , 2011, CHI.

[30]  Thomas Goschke,et al.  Unconscious modulation of the conscious experience of voluntary control , 2007, Cognition.

[31]  Miguel A. Vadillo,et al.  Illusion of Control , 2013, Experimental psychology.

[32]  R. Hohle INFERRED COMPONENTS OF REACTION TIMES AS FUNCTIONS OF FOREPERIOD DURATION. , 1965, Journal of experimental psychology.

[33]  Wei Chu,et al.  Preference learning with Gaussian processes , 2005, ICML.

[34]  Zoran Popovic,et al.  Towards automatic experimentation of educational knowledge , 2014, CHI.

[35]  Javier R. Movellan,et al.  The Faces of Engagement: Automatic Recognition of Student Engagementfrom Facial Expressions , 2014, IEEE Transactions on Affective Computing.

[36]  Alexandre N. Tuch,et al.  A systematic review of quantitative studies on the enjoyment of digital entertainment games , 2014, CHI.

[37]  Vincent Corruble,et al.  Challenge-sensitive action selection: an application to game balancing , 2005, IEEE/WIC/ACM International Conference on Intelligent Agent Technology.

[38]  George Levy An introduction to quasi-random numbers , 2002 .

[39]  Pushmeet Kohli,et al.  Adapting Interaction Environments to Diverse Users through Online Action Set Selection , 2014, AAAI 2014.

[40]  Seiji Isotani,et al.  A systematic mapping on gamification applied to education , 2014, SAC.

[41]  Thomas L. Griffiths,et al.  Optimally Designing Games for Cognitive Science Research , 2012, CogSci.

[42]  Zachary A. Pardos Commentary On "Beyond Time-on-Task: The Relationship Between Spaced Study and Certification in MOOCs" , 2015 .

[43]  Kenneth R. Koedinger,et al.  Optimizing challenge in an educational game using large-scale design experiments , 2013, CHI.