Expressing Coherent Personality with Incremental Acquisition of Multimodal Behaviors

As social robots increasingly enter people's lives, coherence of personality is an important challenge for longterm human-robot interactions. We extend an architecture that acquires dialog through crowdsourcing to author both verbal and non-verbal indicators of personality. We demonstrate the efficacy of the approach through a four-day study in which teams of participants interacted with a social robot expressing one of two personalities as the host of a competitive game. Results indicate that the system is able to elicit personality-driven language behaviors from the crowd in an incremental and ongoing way and produce a coherent expression of that personality during face- to- face interactions over time.

[1]  R. Ryan Control and information in the intrapersonal sphere: An extension of cognitive evaluation theory. , 1982 .

[2]  J. E. Ball,et al.  Emotion and Personality in a Conversational Character , 1998 .

[3]  Atsuo Takanishi,et al.  Robot personality based on the equations of emotion defined in the 3D mental space , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[4]  Eugénio C. Oliveira,et al.  Emotional Valence-Based Mechanisms and Agent Personality , 2002, SBIA.

[5]  Oudeyer Pierre-Yves,et al.  The production and recognition of emotions in speech: features and algorithms , 2003 .

[6]  Pierre-Yves Oudeyer,et al.  The production and recognition of emotions in speech: features and algorithms , 2003, Int. J. Hum. Comput. Stud..

[7]  S. Gosling,et al.  A very brief measure of the Big-Five personality domains , 2003 .

[8]  Cynthia Breazeal,et al.  Emotive qualities in lip-synchronized robot speech , 2003, Adv. Robotics.

[9]  M. Mancini,et al.  Speaking with Emotions , 2004 .

[10]  Ho-Lun Cheng,et al.  Personality-based Adaptation for Teamwork in Game Agents , 2007, AIIDE.

[11]  Adriana Tapus,et al.  User—robot personality matching and assistive robot behavior adaptation for post-stroke rehabilitation therapy , 2008, Intell. Serv. Robotics.

[12]  J. Terken,et al.  The influence of robot personality on perceived and preferred level of user control , 2008 .

[13]  Dana Kulic,et al.  Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots , 2009, Int. J. Soc. Robotics.

[14]  Andrea Esuli,et al.  SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining , 2010, LREC.

[15]  Gabriel Skantze,et al.  Furhat: A Back-Projected Human-Like Robot Head for Multiparty Human-Machine Interaction , 2011, COST 2102 Training School.

[16]  Marilyn A. Walker,et al.  Controlling User Perceptions of Linguistic Style: Trainable Generation of Personality Traits , 2011, CL.

[17]  Emer Gilmartin,et al.  Multimodal conversational interaction with a humanoid robot , 2012, 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom).

[18]  Stefan Kopp,et al.  Generation and Evaluation of Communicative Robot Gesture , 2012, Int. J. Soc. Robotics.

[19]  Walter S. Lasecki,et al.  Conversations in the Crowd: Collecting Data for Task-Oriented Dialog Learning , 2013, Proceedings of the AAAI Conference on Human Computation and Crowdsourcing.

[20]  Jeffrey Nichols,et al.  Chorus: a crowd-powered conversational assistant , 2013, UIST.

[21]  Vanessa Evers,et al.  What you do is who you are: The role of task context in perceived social robot personality , 2013, 2013 IEEE International Conference on Robotics and Automation.

[22]  Adriana Tapus,et al.  A model for synthesizing a combined verbal and nonverbal behavior based on personality traits in human-robot interaction , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[23]  Amy Beth Warriner,et al.  Norms of valence, arousal, and dominance for 13,915 English lemmas , 2013, Behavior Research Methods.

[24]  Quoc V. Le,et al.  Distributed Representations of Sentences and Documents , 2014, ICML.

[25]  Michael Kriegel,et al.  Towards a crowdsourced solution for the authoring bottleneck in interactive narratives , 2015 .

[26]  Daniel H. Grollman,et al.  Infinite Personality Space for Non-fungible Robots , 2016, ICSR.

[27]  Boyang Li,et al.  Semi-situated learning of verbal and nonverbal content for repeated human-robot interaction , 2016, ICMI.

[28]  Steven J. Stroessner,et al.  The Robotic Social Attributes Scale (RoSAS): Development and Validation , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[29]  Boyang Li,et al.  Learning and Reusing Dialog for Repeated Interactions with a Situated Social Agent , 2017, IVA.