From characterising three years of HRI to methodology and reporting recommendations

Human-Robot Interaction (HRI) research requires the integration and cooperation of multiple disciplines, technical and social, in order to make progress. In many cases using different motivations, each of these disciplines bring with them different assumptions and methodologies. We assess recent trends in the field of HRI by examining publications in the HRI conference over the past three years (over 100 full papers), and characterise them according to 14 categories. We focus primarily on aspects of methodology. From this, a series of practical recommendations based on rigorous guidelines from other research fields that have not yet become common practice in HRI are proposed. Furthermore, we explore the primary implications of the observed recent trends for the field more generally, in terms of both methodology and research directions. We propose that the interdisciplinary nature of HRI must be maintained, but that a common methodological approach provides a much needed frame of reference to facilitate rigorous future progress.

[1]  L. Berkowitz,et al.  External validity is more than skin deep: Some answers to criticisms of laboratory experiments. , 1982 .

[2]  M. Artés Statistical errors. , 1977, Medicina clinica.

[3]  Douglas H. Johnson The Insignificance of Statistical Significance Testing , 1999 .

[4]  Elizabeth Sheehy Editorial , 2003 .

[5]  S. Maxwell The persistence of underpowered studies in psychological research: causes, consequences, and remedies. , 2004, Psychological methods.

[6]  G. Cumming,et al.  Replication and Researchers' Understanding of Confidence Intervals and Standard Error Bars. , 2004 .

[7]  Takayuki Kanda,et al.  Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial , 2004, Hum. Comput. Interact..

[8]  Stephanie Rosenthal,et al.  Designing robots for long-term social interaction , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Brian Scassellati,et al.  The Grand Challenges in Socially Assistive Robotics , 2007 .

[10]  Brian Scassellati,et al.  Socially assistive robotics [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[11]  G. Cumming Replication and p Intervals: p Values Predict the Future Only Vaguely, but Confidence Intervals Do Much Better , 2008, Perspectives on psychological science : a journal of the Association for Psychological Science.

[12]  James L. McClelland The Place of Modeling in Cognitive Science , 2009, Top. Cogn. Sci..

[13]  Katharina J. Rohlfing,et al.  Computational Analysis of Motionese Toward Scaffolding Robot Action Learning , 2009, IEEE Transactions on Autonomous Mental Development.

[14]  Aude Billard,et al.  A survey of Tactile Human-Robot Interactions , 2010, Robotics Auton. Syst..

[15]  Christoph Bartneck The end of the beginning: a reflection on the first five years of the HRI conference , 2010, Scientometrics.

[16]  Paul Baxter,et al.  Child-robot interaction in the wild: advice to the aspiring experimenter , 2011, ICMI '11.

[17]  R. Peng Reproducible Research in Computational Science , 2011, Science.

[18]  Laurel D. Riek,et al.  Wizard of Oz studies in HRI , 2012, HRI 2012.

[19]  Ana Paiva,et al.  Social Robots for Long-Term Interaction: A Survey , 2013, Int. J. Soc. Robotics.

[20]  Carolyn Penstein Rosé,et al.  Effects of Social Presence and Social Role on Help-Seeking and Learning , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[21]  P. Dillenbourg,et al.  The Cognitive Correlates of Anthropomorphism , 2014, HRI 2014.

[22]  Regina Nuzzo,et al.  Scientific method: Statistical errors , 2014, Nature.

[23]  A. Deletic,et al.  Interdisciplinarity: How to catalyse collaboration , 2015, Nature.

[24]  Michael C. Frank,et al.  Estimating the reproducibility of psychological science , 2015, Science.