Challenges in Exploiting Conversational Memory in Human-Agent Interaction

In human interactions, language is used to project and maintain a social identity over time. The way people speak with others and revisit language across repeated interactions helps to create rapport and develop a feeling of coordination between conversational partners. Memory of past conversations is the main mechanism that allows us to exploit and explore ways of speaking, given knowledge acquired in previous encounters. As such, we introduce an agent that uses its conversational memory to revisit shared history with users to maintain a coherent social relationship over time. In this paper, we describe the dialog management mechanisms to achieve these goals when applied to a robot that engages in social chit-chat. In a study lasting 14 days with 28 users, totaling 474 interactions, we find that it is difficult to leverage the shared history with individual users and to also accommodate to expected conversational coordination patterns. We discuss the implications of this finding for long-term human-agent interaction. In particular, we highlight the importance of topic modeling and signaling explicit recall of previous episodes. Moreover, the way that users contribute to interactions requires additional adaptation, indicating a significant challenge for language interaction designers.

[1]  Haizhou Li,et al.  IRIS: a Chat-oriented Dialogue System based on the Vector Space Model , 2012, ACL.

[2]  Xiang Zhang,et al.  Evaluating Prerequisite Qualities for Learning End-to-End Dialog Systems , 2015, ICLR.

[3]  M. Hecht The Conceptualization and Measurement of Interpersonal Communication Satisfaction. , 1978 .

[4]  H. Giles,et al.  Speech Accommodation Theory: The First Decade and Beyond , 1987 .

[5]  Juan Fasola,et al.  A socially assistive robot exercise coach for the elderly , 2013, HRI 2013.

[6]  Christopher D. Manning,et al.  Advances in natural language processing , 2015, Science.

[7]  Jianfeng Gao,et al.  Deep Reinforcement Learning for Dialogue Generation , 2016, EMNLP.

[8]  Elena Márquez Segura,et al.  Memory and the design of migrating virtual agents , 2013, AAMAS.

[9]  Boyang Li,et al.  Semi-situated learning of verbal and nonverbal content for repeated human-robot interaction , 2016, ICMI.

[10]  Matthias Scheutz,et al.  Toward Humanlike Task-Based Dialogue Processing for Human Robot Interaction , 2011, AI Mag..

[11]  Katherine Nelson,et al.  Self and social functions: Individual autobiographical memory and collective narrative , 2003, Memory.

[12]  Houfeng Wang,et al.  Learning to Rank Semantic Coherence for Topic Segmentation , 2017, EMNLP.

[13]  Zhou Yu,et al.  Strategy and Policy Learning for Non-Task-Oriented Conversational Systems , 2016, SIGDIAL Conference.

[14]  Gabriel Skantze,et al.  Furhat: A Back-Projected Human-Like Robot Head for Multiparty Human-Machine Interaction , 2011, COST 2102 Training School.

[15]  Ran Zhao,et al.  Socially-Aware Animated Intelligent Personal Assistant Agent , 2016, SIGDIAL Conference.

[16]  Catherine Pelachaud,et al.  Towards a Socially Adaptive Virtual Agent , 2015, IVA.

[17]  Avelino J. Gonzalez,et al.  Remembering a Conversation – A Conversational Memory Architecture for Embodied Conversational Agents , 2017, J. Intell. Syst..

[18]  Joelle Pineau,et al.  Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models , 2015, AAAI.

[19]  Victor Zue,et al.  PEGASUS: A spoken dialogue interface for on-line air travel planning , 1994, Speech Communication.

[20]  Dimitrios Antos,et al.  Using Emotions to Enhance Decision-Making , 2011, IJCAI.

[21]  John E. Laird,et al.  A Year of Episodic Memory , 2009 .

[22]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[23]  H. Giles,et al.  Speech-accommodation theories: a discussion in terms of second-language acquisition , 1984 .

[24]  Ana Paiva,et al.  MAY: My Memories Are Yours , 2010, IVA.

[25]  John Zakos,et al.  CLIVE - An Artificially Intelligent Chat Robot for Conversational Language Practice , 2008, SETN.

[26]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[27]  Deborah Richards,et al.  ForgetMeNot: What and how users expect intelligent virtual agents to recall and forget personal conversational content , 2014, Int. J. Hum. Comput. Stud..

[28]  Quoc V. Le,et al.  A Neural Conversational Model , 2015, ArXiv.

[29]  Angela Carrillo Ramos,et al.  XPLODIV: An Exploitation-Exploration Aware Diversification Approach for Recommender Systems , 2015, FLAIRS Conference.

[30]  Maxine Eskénazi,et al.  Let's go public! taking a spoken dialog system to the real world , 2005, INTERSPEECH.

[31]  Jennifer C. Lai,et al.  Conversational interfaces , 2000, CACM.

[32]  Boyang Li,et al.  Learning and Reusing Dialog for Repeated Interactions with a Situated Social Agent , 2017, IVA.

[33]  Alan Ritter,et al.  Data-Driven Response Generation in Social Media , 2011, EMNLP.

[34]  Zhou Yu,et al.  Incremental Coordination: Attention-Centric Speech Production in a Physically Situated Conversational Agent , 2015, SIGDIAL Conference.