Rapid Skill Capture in a First-Person Shooter

Various aspects of computer game design, including adaptive elements of game levels, characteristics of “bot” behavior, and player matching in multiplayer games, would ideally be sensitive to a player’s skill level. Yet, while game difficulty and player learning have been explored in the context of games, there has been little work analyzing skill per se, and how this is related to the interaction of a player with the controls of the game—the player’s input. To this end, we present a data set of 476 game logs from over 40 players of a first-person shooter game (Red Eclipse) as a basis of a case study. We then extract features from the keyboard and mouse input and provide an analysis in relation to skill. Finally, we show that a player’s skill can be predicted using less than a minute of their keyboard presses. We suggest that the techniques used here are useful for adapting games to match players’ skill levels rapidly, arguably more rapidly than solutions based on performance averaging such as TrueSkill.

[1]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[2]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[3]  J. Kruger,et al.  Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments. , 1999, Journal of personality and social psychology.

[4]  Julian Togelius,et al.  Give me a reason to dig Minecraft and psychology of motivation , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[5]  Vincent Corruble,et al.  Extending Reinforcement Learning to Provide Dynamic Game Balancing , 2005 .

[6]  Guy Haworth Gentlemen, Stop Your Engines! , 2007, J. Int. Comput. Games Assoc..

[7]  Georgios N. Yannakakis,et al.  Ranking vs. Preference: A Comparative Study of Self-reporting , 2011, ACII.

[8]  Arthur Tay,et al.  Dynamic Game Difficulty Scaling Using Adaptive Behavior-Based AI , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[9]  Gabriel Synnaeve,et al.  A Dataset for StarCraft AI and an Example of Armies Clustering , 2012 .

[10]  Arin Ghazarian,et al.  Automatic detection of users’ skill levels using high-frequency user interface events , 2010, User Modeling and User-Adapted Interaction.

[11]  Carlos Delgado-Mata,et al.  Dynamic Difficulty Adjusting Strategy for a Two-player Video Game , 2013 .

[12]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[13]  Simon Colton,et al.  Unsupervised Modeling of Player Style With LDA , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[14]  Julian Togelius,et al.  Modeling Player Experience for Content Creation , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[15]  D. Huffman A Method for the Construction of Minimum-Redundancy Codes , 1952 .

[16]  J. Platt Sequential Minimal Optimization : A Fast Algorithm for Training Support Vector Machines , 1998 .

[17]  Georgios N. Yannakakis,et al.  Towards affective camera control in games , 2010, User Modeling and User-Adapted Interaction.

[18]  Tom Minka,et al.  TrueSkill Through Time: Revisiting the History of Chess , 2007, NIPS.

[19]  R. Likert “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[20]  Kostas Karpouzis,et al.  A Game-Based Corpus for Analysing the Interplay between Game Context and Player Experience , 2011, ACII.

[21]  Scott E. Hudson,et al.  Dynamic detection of novice vs. skilled use without a task model , 2007, CHI.

[22]  Giuseppe Di Fatta,et al.  Skill rating by Bayesian inference , 2009, 2009 IEEE Symposium on Computational Intelligence and Data Mining.

[23]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[24]  C. Aberson Applied Power Analysis for the Behavioral Sciences , 2010 .

[25]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[26]  K. Pearson VII. Note on regression and inheritance in the case of two parents , 1895, Proceedings of the Royal Society of London.

[27]  James F. Parker,et al.  Ability factors and component performance measures as predictors of complex tracking behavior. , 1960 .

[28]  Kostas Karpouzis,et al.  The platformer experience dataset , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[29]  S. Guzzetti,et al.  Physiological time-series analysis using approximate entropy and sample entropy , 2000 .

[30]  Pieter Spronck,et al.  Player Skill Modeling in Starcraft II , 2013, AIIDE.

[31]  David C. Hoaglin,et al.  Some Implementations of the Boxplot , 1989 .

[32]  Yoshua Bengio,et al.  Beyond Skill Rating: Advanced Matchmaking in Ghost Recon Online , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[33]  Simon M. Lucas,et al.  Predicting Dominance Rankings for Score-Based Games , 2016, IEEE Transactions on Computational Intelligence and AI in Games.

[34]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[35]  Terry A. Welch,et al.  A Technique for High-Performance Data Compression , 1984, Computer.

[36]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .

[37]  Julian Togelius,et al.  Predicting player behavior in Tomb Raider: Underworld , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[38]  Tom Minka,et al.  TrueSkillTM: A Bayesian Skill Rating System , 2006, NIPS.

[39]  G. Fechner Elemente der Psychophysik , 1998 .

[40]  David Laibson,et al.  Experienced Utility and Objective Happiness: A Moment-Based Approach , 2001 .

[41]  M. Toda,et al.  Fighting game skill evaluation method using surface EMG signal , 2012, The 1st IEEE Global Conference on Consumer Electronics 2012.

[42]  Andrea Bonarini,et al.  Enjoyment recognition from physiological data in a car racing game , 2010, AFFINE '10.

[43]  A. Elo The rating of chessplayers, past and present , 1978 .

[44]  Georgios N. Yannakakis,et al.  Player modeling using self-organization in Tomb Raider: Underworld , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[45]  D. Hoang FLOW: The Psychology of Optimal Experience , 2018 .

[46]  Jie Yang,et al.  Towards human-robot coordination: skill modeling and transferring via hidden Markov model , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[47]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[48]  Caroline Jay,et al.  Understanding users in the wild , 2013, W4A.

[49]  Nancy J Hogle,et al.  Does training novices to criteria and does rapid acquisition of skills on laparoscopic simulators have predictive validity or are we just playing video games? , 2008, Journal of surgical education.

[50]  Ke Chen,et al.  Predicting skill from gameplay input to a first-person shooter , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[51]  David A. Huffman,et al.  A method for the construction of minimum-redundancy codes , 1952, Proceedings of the IRE.