From Machine Learning to Robotics: Challenges and Opportunities for Embodied Intelligence

Machine learning has long since become a keystone technology, accelerating science and applications in a broad range of domains. Consequently, the notion of applying learning methods to a particular problem set has become an established and valuable modus operandi to advance a particular field. In this article we argue that such an approach does not straightforwardly extended to robotics — or to embodied intelligence more generally: systems which engage in a purposeful exchange of energy and information with a physical environment. In particular, the purview of embodied intelligent agents extends significantly beyond the typical considerations of main-stream machine learning approaches, which typically (i) do not consider operation under conditions significantly different from those encountered during training; (ii) do not consider the often substantial, long-lasting and potentially safety-critical nature of interactions during learning and deployment; (iii) do not require ready adaptation to novel tasks while at the same time (iv) effectively and efficiently curating and extending their models of the world through targeted and deliberate actions. In reality, therefore, these limitations result in learning-based systems which suffer from many of the same operational shortcomings as more traditional, engineering-based approaches when deployed on a robot outside a well defined, and often narrow operating envelope. Contrary to viewing embodied intelligence as another application domain for machine learning, here we argue that it is in fact a key driver for the advancement of machine learning technology. In this article our goal is to highlight challenges and opportunities that are specific to embodied intelligence and to propose research directions which may significantly advance the state-of-the-art in robot learning.

[1]  Chong Wang,et al.  Neural Logic Machines , 2019, ICLR.

[2]  L. P. Kaelbling,et al.  Learning Symbolic Models of Stochastic Domains , 2007, J. Artif. Intell. Res..

[3]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[4]  Peter Stone,et al.  Learning to Interpret Natural Language Commands through Human-Robot Dialog , 2015, IJCAI.

[5]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[6]  Bernhard Schölkopf,et al.  Recurrent Independent Mechanisms , 2021, ICLR.

[7]  Marc Toussaint,et al.  Differentiable Physics and Stable Modes for Tool-Use and Manipulation Planning , 2018, Robotics: Science and Systems.

[8]  Nicholas Roy,et al.  Efficient Grounding of Abstract Spatial Concepts for Natural Language Interaction with Robot Manipulators , 2016, Robotics: Science and Systems.

[9]  Mark Steedman,et al.  Object-Action Complexes: Grounded abstractions of sensory-motor processes , 2011, Robotics Auton. Syst..

[10]  Joshua B. Tenenbaum,et al.  Building machines that learn and think like people , 2016, Behavioral and Brain Sciences.

[11]  Oliver Brock,et al.  Four aspects of building robotic systems: lessons from the Amazon Picking Challenge 2015 , 2018, Auton. Robots.

[12]  George Konidaris,et al.  Learning Symbolic Representations for Planning with Parameterized Skills , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Jürgen Leitner,et al.  Learning robust, real-time, reactive robotic grasping , 2019, Int. J. Robotics Res..

[14]  S. Levine,et al.  Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems , 2020, ArXiv.

[15]  Chen Sun,et al.  Discrete-Valued Neural Communication , 2021, NeurIPS.

[16]  Leslie Pack Kaelbling,et al.  Differentiable Algorithm Networks for Composable Robot Learning , 2019, Robotics: Science and Systems.

[17]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[18]  Shimon Whiteson,et al.  TreeQN and ATreeC: Differentiable Tree Planning for Deep Reinforcement Learning , 2017, ICLR 2018.

[19]  Matthew R. Walter,et al.  Inferring Compact Representations for Efficient Natural Language Understanding of Robot Instructions , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[20]  Jiajun Wu,et al.  Galileo: Perceiving Physical Object Properties by Integrating a Physics Engine with Deep Learning , 2015, NIPS.

[21]  Matthew Botvinick,et al.  MONet: Unsupervised Scene Decomposition and Representation , 2019, ArXiv.

[22]  Leslie Pack Kaelbling,et al.  FFRob: Leveraging symbolic planning for efficient task and motion planning , 2016, Int. J. Robotics Res..

[23]  John K. Tsotsos,et al.  Robot navigation via spatial and temporal coherent semantic maps , 2016, Eng. Appl. Artif. Intell..

[24]  Dieter Fox,et al.  BayesSim: adaptive domain randomization via probabilistic inference for robotics simulators , 2019, Robotics: Science and Systems.

[25]  Jane X. Wang,et al.  Reinforcement Learning, Fast and Slow , 2019, Trends in Cognitive Sciences.

[26]  Sergey Levine,et al.  Data-Efficient Hierarchical Reinforcement Learning , 2018, NeurIPS.

[27]  Michael Beetz,et al.  PR2 looking at things — Ensemble learning for unstructured information processing with Markov logic networks , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Alex S. Fukunaga,et al.  Classical Planning in Deep Latent Space: Bridging the Subsymbolic-Symbolic Boundary , 2017, AAAI.

[29]  Raquel Urtasun,et al.  Physically Realizable Adversarial Examples for LiDAR Object Detection , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Andrea Vedaldi,et al.  ShapeStacks: Learning Vision-Based Physical Intuition for Generalised Object Stacking , 2018, ECCV.

[31]  永福 智志 The Organization of Learning , 2005, Journal of Cognitive Neuroscience.

[32]  Alex Bewley,et al.  Dropout Distillation for Efficiently Estimating Model Confidence , 2018, ArXiv.

[33]  Ingmar Posner,et al.  Fit for Purpose? Predicting Perception Performance Based on Past Experience , 2016, ISER.

[34]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[35]  A. E. Eiben,et al.  Evolving embodied intelligence from materials to machines , 2019, Nat. Mach. Intell..

[36]  Florentin Wörgötter,et al.  Symbol Emergence in Cognitive Developmental Systems: A Survey , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[37]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation: Part I—Theory , 1985 .

[38]  Matej Hoffmann,et al.  What Is Morphological Computation? On How the Body Contributes to Cognition and Control , 2017, Artificial Life.

[39]  Thomas J. Walsh,et al.  Knows what it knows: a framework for self-aware learning , 2008, ICML '08.

[40]  Calin Belta,et al.  A Fully Automated Framework for Control of Linear Systems from Temporal Logic Specifications , 2008, IEEE Transactions on Automatic Control.

[41]  Abhinav Gupta,et al.  Supersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[42]  Joan Bruna,et al.  Intriguing properties of neural networks , 2013, ICLR.

[43]  Doina Precup,et al.  Between MDPs and Semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning , 1999, Artif. Intell..

[44]  R. Byrne,et al.  Animal Tool-Use , 2010, Current Biology.

[45]  Yee Whye Teh,et al.  Continual Unsupervised Representation Learning , 2019, NeurIPS.

[46]  Daan Wierstra,et al.  Variational Intrinsic Control , 2016, ICLR.

[47]  Doina Precup,et al.  Flow Network based Generative Models for Non-Iterative Diverse Candidate Generation , 2021, NeurIPS.

[48]  Claude Sammut,et al.  The Robot Engineer , 2015, ILP.

[49]  Michael S. Bernstein,et al.  Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations , 2016, International Journal of Computer Vision.

[50]  Ophelia Deroy,et al.  Metacognition in Multisensory Perception , 2016, Trends in Cognitive Sciences.

[51]  Ivan Bratko Comparison of Machine Learning for Autonomous Robot Discovery , 2010, Advances in Machine Learning I.

[52]  Charles Richter,et al.  Safe Visual Navigation via Deep Learning and Novelty Detection , 2017, Robotics: Science and Systems.

[53]  Dmitry Berenson,et al.  No falls, no resets: Reliable humanoid behavior in the DARPA robotics challenge , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[54]  Sergey Levine,et al.  Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning , 2019, CoRL.

[55]  Daniel J. Hsu Algorithms for active learning , 2010 .

[56]  George Konidaris,et al.  Option Discovery using Deep Skill Chaining , 2020, ICLR.

[57]  Martial Hebert,et al.  Introspective perception: Learning to predict failures in vision systems , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[58]  Qiang Xu,et al.  nuScenes: A Multimodal Dataset for Autonomous Driving , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[59]  Mario Fritz,et al.  Visual stability prediction for robotic manipulation , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[60]  Vikash K. Mansinghka,et al.  Reconciling intuitive physics and Newtonian mechanics for colliding objects. , 2013, Psychological review.

[61]  Daniel E. Koditschek,et al.  What Is Robotics? Why Do We Need It and How Can We Get It? , 2021, Annu. Rev. Control. Robotics Auton. Syst..

[62]  David Pfau,et al.  Towards a Definition of Disentangled Representations , 2018, ArXiv.

[63]  Ingmar Posner,et al.  GENESIS: Generative Scene Inference and Sampling with Object-Centric Latent Representations , 2019, ICLR.

[64]  Ingmar Posner,et al.  There and Back Again: Learning to Simulate Radar Data for Real-World Applications , 2020, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[65]  Leslie Pack Kaelbling,et al.  From Skills to Symbols: Learning Symbolic Representations for Abstract High-Level Planning , 2018, J. Artif. Intell. Res..

[66]  Richard Evans,et al.  Learning Explanatory Rules from Noisy Data , 2017, J. Artif. Intell. Res..

[67]  Larry Shapiro The Embodied Cognition Research Programme , 2007 .

[68]  Sergey Levine,et al.  Sim2Real View Invariant Visual Servoing by Recurrent Control , 2017 .

[69]  Germán Ros,et al.  CARLA: An Open Urban Driving Simulator , 2017, CoRL.

[70]  Edward H. Adelson,et al.  Localization and manipulation of small parts using GelSight tactile sensing , 2014, IROS.

[71]  Vikash K. Mansinghka,et al.  Gen: a general-purpose probabilistic programming system with programmable inference , 2019, PLDI.

[72]  Yoshua Bengio,et al.  DEUP: Direct Epistemic Uncertainty Prediction , 2021, ArXiv.

[73]  Ivan Bratko,et al.  An Experiment in Robot Discovery with ILP , 2008, ILP.

[74]  Yoshua Bengio,et al.  The Consciousness Prior , 2017, ArXiv.

[75]  Silvio Savarese,et al.  3D Scene Graph: A Structure for Unified Semantics, 3D Space, and Camera , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[76]  Luc De Raedt,et al.  Relational Kernel-Based Grasping with Numerical Features , 2015, ILP.

[77]  Javier Civera,et al.  Towards semantic SLAM using a monocular camera , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[78]  Ingmar Posner,et al.  Find your own way: Weakly-supervised segmentation of path proposals for urban autonomy , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[79]  William Yang Wang,et al.  A Soft Version of Predicate Invention Based on Structured Sparsity , 2015, IJCAI.

[80]  Sanjit A. Seshia,et al.  Reactive synthesis from signal temporal logic specifications , 2015, HSCC.

[81]  Michael J. Black,et al.  Attacking Optical Flow , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[82]  Alberto Rodriguez,et al.  TossingBot: Learning to Throw Arbitrary Objects With Residual Physics , 2019, IEEE Transactions on Robotics.

[83]  Sven Cremer,et al.  On the performance of the Baxter research robot , 2016, 2016 IEEE International Symposium on Assembly and Manufacturing (ISAM).

[84]  Michael T. Cox Metacognition in computation: A selected research review , 2005, Artif. Intell..

[85]  Stefan Schaal,et al.  Skill learning and task outcome prediction for manipulation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[86]  Jitendra Malik,et al.  Habitat: A Platform for Embodied AI Research , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[87]  Mykel J. Kochenderfer,et al.  A Survey of Algorithms for Black-Box Safety Validation , 2020, J. Artif. Intell. Res..

[88]  Luke S. Zettlemoyer,et al.  Learning to Parse Natural Language Commands to a Robot Control System , 2012, ISER.

[89]  Tom M. Mitchell,et al.  The Need for Biases in Learning Generalizations , 2007 .

[90]  Paul Newman,et al.  Adversarial Training for Adverse Conditions: Robust Metric Localisation Using Appearance Transfer , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[91]  B. Baars A cognitive theory of consciousness , 1988 .

[92]  Sergey Levine,et al.  Diversity is All You Need: Learning Skills without a Reward Function , 2018, ICLR.

[93]  Dragomir Anguelov,et al.  Scalability in Perception for Autonomous Driving: Waymo Open Dataset , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[94]  Nikos Komodakis,et al.  GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoders , 2018, ICANN.

[95]  Leslie Pack Kaelbling,et al.  Constructing Symbolic Representations for High-Level Planning , 2014, AAAI.

[96]  Adam Wierman,et al.  Thinking Fast and Slow , 2017, SIGMETRICS Perform. Evaluation Rev..

[97]  Jiajun Wu,et al.  Learning to See Physics via Visual De-animation , 2017, NIPS.

[98]  Ruzena Bajcsy,et al.  Signal-to-symbol transformation and vice versa: from fundamental processes to representation , 1995, CSUR.

[99]  Jeannette Bohg,et al.  Leveraging big data for grasp planning , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[100]  Tor Lattimore,et al.  Unifying PAC and Regret: Uniform PAC Bounds for Episodic Reinforcement Learning , 2017, NIPS.

[101]  Silvia Coradeschi,et al.  A Short Review of Symbol Grounding in Robotic and Intelligent Systems , 2013, KI - Künstliche Intelligenz.

[102]  Sergey Levine,et al.  Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks , 2017, ICML.

[103]  Dumitru Erhan,et al.  SurfelGAN: Synthesizing Realistic Sensor Data for Autonomous Driving , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[104]  Leslie Pack Kaelbling,et al.  Neural Relational Inference with Fast Modular Meta-learning , 2019, NeurIPS.

[105]  Zenon W. Pylyshyn,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[106]  Martin A. Riedmiller,et al.  Embed to Control: A Locally Linear Latent Dynamics Model for Control from Raw Images , 2015, NIPS.

[107]  Gaurav S. Sukhatme,et al.  An autonomous manipulation system based on force control and optimization , 2014, Auton. Robots.

[108]  Nicholas Roy,et al.  Sensor-Based Reactive Symbolic Planning in Partially Known Environments , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[109]  Jorge Pena Queralta,et al.  Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey , 2020, 2020 IEEE Symposium Series on Computational Intelligence (SSCI).

[110]  George J. Pappas,et al.  Semantic Localization Via the Matrix Permanent , 2014, Robotics: Science and Systems.

[111]  H. Simon,et al.  Rational choice and the structure of the environment. , 1956, Psychological review.

[112]  Russ Tedrake,et al.  Neural Bridge Sampling for Evaluating Safety-Critical Autonomous Systems , 2020, NeurIPS.

[113]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[114]  Stephen Muggleton,et al.  Inductive logic programming at 30 , 2021, Machine Learning.

[115]  Kenneth Y. Goldberg,et al.  Learning Deep Policies for Robot Bin Picking by Simulating Robust Grasping Sequences , 2017, CoRL.

[116]  Byron Boots,et al.  Differentiable MPC for End-to-end Planning and Control , 2018, NeurIPS.

[117]  Xinlei Chen,et al.  Never-Ending Learning , 2012, ECAI.

[118]  Wolfram Burgard,et al.  Perspectives on Deep Multimodel Robot Learning , 2017, ISRR.

[119]  Winston Churchill,et al.  Off the beaten track: Predicting localisation performance in visual teach and repeat , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[120]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[121]  Danica Kragic,et al.  Analytic grasp success prediction with tactile feedback , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[122]  Oliver Brock,et al.  Analysis and Observations From the First Amazon Picking Challenge , 2016, IEEE Transactions on Automation Science and Engineering.

[123]  Nan Jiang,et al.  Hierarchical Imitation and Reinforcement Learning , 2018, ICML.

[124]  Leslie Pack Kaelbling,et al.  Integrated Task and Motion Planning , 2020, Annu. Rev. Control. Robotics Auton. Syst..

[125]  Marc Toussaint,et al.  Logic-Geometric Programming: An Optimization-Based Approach to Combined Task and Motion Planning , 2015, IJCAI.

[126]  Rudolph Triebel,et al.  Introspective classification for robot perception , 2016, Int. J. Robotics Res..

[127]  M. Strathern ‘Improving ratings’: audit in the British University system , 1997, European Review.

[128]  Rob Fergus,et al.  Learning Physical Intuition of Block Towers by Example , 2016, ICML.

[129]  Mathijs Mul,et al.  The compositionality of neural networks: integrating symbolism and connectionism , 2019, ArXiv.

[130]  David Barber,et al.  Thinking Fast and Slow with Deep Learning and Tree Search , 2017, NIPS.

[131]  Geoffrey E. Hinton,et al.  Attend, Infer, Repeat: Fast Scene Understanding with Generative Models , 2016, NIPS.

[132]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[133]  Alex Lamb,et al.  Coordination Among Neural Modules Through a Shared Global Workspace , 2021, ArXiv.

[134]  Jessica B. Hamrick,et al.  Simulation as an engine of physical scene understanding , 2013, Proceedings of the National Academy of Sciences.

[135]  Yee Whye Teh,et al.  Exploiting Hierarchy for Learning and Transfer in KL-regularized RL , 2019, ArXiv.

[136]  Priya L. Donti,et al.  SATNet: Bridging deep learning and logical reasoning using a differentiable satisfiability solver , 2019, ICML.

[137]  Jiajun Wu,et al.  Entity Abstraction in Visual Model-Based Reinforcement Learning , 2019, CoRL.

[138]  Christoph H. Lampert,et al.  A PAC-Bayesian bound for Lifelong Learning , 2013, ICML.

[139]  Ali Payani,et al.  Differentiable neural logic networks and their application onto inductive logic programming , 2020 .

[140]  Leslie Pack Kaelbling,et al.  Augmenting Physical Simulators with Stochastic Neural Networks: Case Study of Planar Pushing and Bouncing , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[141]  Peter V. Gehler,et al.  Towards causal generative scene models via competition of experts , 2020, ArXiv.

[142]  Sergey Levine,et al.  SimGAN: Hybrid Simulator Identification for Domain Adaptation via Adversarial Reinforcement Learning , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[143]  Harri Valpola,et al.  Tagger: Deep Unsupervised Perceptual Grouping , 2016, NIPS.

[144]  Sebastian Thrun,et al.  Lifelong robot learning , 1993, Robotics Auton. Syst..

[145]  Richard Fikes,et al.  Learning and Executing Generalized Robot Plans , 1993, Artif. Intell..

[146]  Matthew R. Walter,et al.  Approaching the Symbol Grounding Problem with Probabilistic Graphical Models , 2011, AI Mag..

[147]  Leslie Pack Kaelbling,et al.  The foundation of efficient robot learning , 2020, Science.

[148]  Yoshua Bengio,et al.  Inductive Biases for Deep Learning of Higher-Level Cognition , 2020, ArXiv.

[149]  Oliver Brock,et al.  Surprisingly Robust In-Hand Manipulation: An Empirical Study , 2021, Robotics: Science and Systems.

[150]  Peter Stone,et al.  Autonomous Task Sequencing for Customized Curriculum Design in Reinforcement Learning , 2017, IJCAI.

[151]  Massimiliano Pontil,et al.  Learning Discrete Structures for Graph Neural Networks , 2019, ICML.

[152]  L. Reder,et al.  What determines initial feeling of knowing? Familiarity with question terms, not with the answer , 1992 .

[153]  Sergey Levine,et al.  Reasoning About Physical Interactions with Object-Oriented Prediction and Planning , 2018, ICLR.

[154]  Thomas G. Dietterich Hierarchical Reinforcement Learning with the MAXQ Value Function Decomposition , 1999, J. Artif. Intell. Res..

[155]  Yoshua Bengio,et al.  GMNN: Graph Markov Neural Networks , 2019, ICML.

[156]  Demis Hassabis,et al.  Mastering Atari, Go, chess and shogi by planning with a learned model , 2019, Nature.

[157]  G. Lakoff,et al.  Metaphors We Live by , 1982 .

[158]  Nicholas Roy,et al.  Efficient Planning for Near-Optimal Compliant Manipulation Leveraging Environmental Contact , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[159]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[160]  Rolf Pfeifer,et al.  How the body shapes the way we think - a new view on intelligence , 2006 .

[161]  D. Wolpert The Supervised Learning No-Free-Lunch Theorems , 2002 .

[162]  Michael J. Witbrock,et al.  Searching for Common Sense: Populating Cyc™ from the Web , 2005, AAAI.

[163]  Charles Blundell,et al.  Neural Production Systems , 2021, ArXiv.

[164]  Joshua B. Tenenbaum,et al.  Picture: A probabilistic programming language for scene perception , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[165]  Oliver Brock,et al.  Active Acoustic Contact Sensing for Soft Pneumatic Actuators , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[166]  Silvio Savarese,et al.  iGibson 1.0: A Simulation Environment for Interactive Tasks in Large Realistic Scenes , 2020, 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[167]  Klaus Greff,et al.  Multi-Object Representation Learning with Iterative Variational Inference , 2019, ICML.

[168]  Stefano Nolfi,et al.  Embodied Intelligence , 2015, Handbook of Computational Intelligence.

[169]  B. Baars IN THE THEATRE OF CONSCIOUSNESS Global Workspace Theory, A Rigorous Scientific Theory of Consciousness. , 1997 .

[170]  Maximilian Karl,et al.  Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data , 2016, ICLR.

[171]  Sergey Levine,et al.  Learning Hand-Eye Coordination for Robotic Grasping with Large-Scale Data Collection , 2016, ISER.

[172]  Jakub W. Pachocki,et al.  Learning dexterous in-hand manipulation , 2018, Int. J. Robotics Res..

[173]  Simon Lucey,et al.  Argoverse: 3D Tracking and Forecasting With Rich Maps , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[174]  Yee Whye Teh,et al.  Sequential Attend, Infer, Repeat: Generative Modelling of Moving Objects , 2018, NeurIPS.

[175]  Benjamin Kuipers,et al.  Autonomous Learning of High-Level States and Actions in Continuous Environments , 2012, IEEE Transactions on Autonomous Mental Development.

[176]  Joanna Isabelle Olszewska,et al.  A review and comparison of ontology-based approaches to robot autonomy , 2019, The Knowledge Engineering Review.

[177]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[178]  Hadas Kress-Gazit,et al.  Temporal-Logic-Based Reactive Mission and Motion Planning , 2009, IEEE Transactions on Robotics.

[179]  Aaron C. Courville,et al.  Systematic Generalization: What Is Required and Can It Be Learned? , 2018, ICLR.

[180]  Masataro Asai,et al.  Unsupervised Grounding of Plannable First-Order Logic Representation from Images , 2019, ICAPS.

[181]  Rodney A. Brooks,et al.  Real Robots, Real Learning Problems , 1993 .

[182]  Kate Saenko,et al.  Learning Multi-Level Hierarchies with Hindsight , 2017, ICLR.

[183]  Giorgio Metta,et al.  A Flexible and Robust Large Scale Capacitive Tactile System for Robots , 2013, IEEE Sensors Journal.