Application-Independent and Integration-Friendly Natural Language Understanding

Natural Language Understanding (NLU) has been a long-standing goal of AI and many related fields, but it is often dismissed as very hard to solve. NLU is required complex flexible systems that take action without further human intervention. This inherently involves strong semantic (meaning) capabilities to parse queries and commands correctly and with high confidence, because an error by a robot or automated vehicle could be disastrous. We describe an implemented general framework, the ECG2 system, that supports the deployment of NLU systems over a wide range of application domains. The framework is based on decades of research on embodied action-oriented semantics and efficient computational realization of a deep semantic analyzer (parser). This makes it linguistically much more flexible, general and reliable than existing shallow approaches that process language without considering its deeper semantics. In this paper we describe our work from a Computer Science perspective of system integration, and show why our particular architecture requires considerably less effort to connect the system to new applications compared to other language processing tools.

[1]  Hector J. Levesque,et al.  The Winograd Schema Challenge , 2011, AAAI Spring Symposium: Logical Formalizations of Commonsense Reasoning.

[2]  Johan Bos,et al.  Wide-Coverage Semantic Analysis with Boxer , 2008, STEP.

[3]  Pierre Lison,et al.  Situated Dialogue Processing for Human-Robot Interaction , 2010, Cognitive Systems.

[4]  Luke S. Zettlemoyer,et al.  Learning to Parse Natural Language Commands to a Robot Control System , 2012, ISER.

[5]  Matthias Scheutz,et al.  Robust spoken instruction understanding for HRI , 2010, HRI 2010.

[6]  Evan A. Krause,et al.  Novel Mechanisms for Natural Human-Robot Interactions in the DIARC Architecture , 2013 .

[7]  Luc Steels,et al.  Design patterns in fluid construction grammar , 2011 .

[8]  Johan Bos,et al.  Linguistically Motivated Large-Scale NLP with C&C and Boxer , 2007, ACL.

[9]  Mehul Bhatt,et al.  Approximate Epistemic Planning with Postdiction as Answer-Set Programming , 2013, LPNMR.

[10]  Jerome A. Feldman,et al.  Embodied Construction Grammar , 2009 .

[11]  C. Fillmore FRAME SEMANTICS AND THE NATURE OF LANGUAGE * , 1976 .

[12]  Henrik I. Christensen,et al.  Situated Dialogue and Spatial Organization: What, Where… and Why? , 2007 .

[13]  Daniel Povey,et al.  The Kaldi Speech Recognition Toolkit , 2011 .

[14]  Franziska Frankfurter,et al.  Constructions: A construction grammar approach to argument structure: Adele E. Goldberg, Chicago, IL: The University of Chicago Press, 1995. xi + 265 pp , 1998 .

[15]  William Croft,et al.  Radical Construction Grammar: Syntactic Theory in Typological Perspective , 2001 .

[16]  Jerome A. Feldman,et al.  Best-fit constructional analysis , 2008 .

[17]  Huda Khayrallah,et al.  Natural Language For Human Robot Interaction , 2015 .

[18]  Jerome A. Feldman,et al.  Natural Language Understanding and Communication for Multi-Agent Systems , 2015, AAAI Fall Symposia.

[19]  Mark Steedman,et al.  The syntactic process , 2004, Language, speech, and communication.

[20]  Jerome A. Feldman,et al.  Exploiting deep semantics and compositionality of natural language for Human-Robot-Interaction , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).