Cognitive Intelligence: Deep Learning, Thinking, and Reasoning by Brain-Inspired Systems

The theme of IEEE ICCI*CC'16 on Cognitive Informatics CI and Cognitive Computing CC was on cognitive computers, big data cognition, and machine learning. CI and CC are a contemporary field not only for basic studies on the brain, computational intelligence theories, and denotational mathematics, but also for engineering applications in cognitive systems towards deep learning, deep thinking, and deep reasoning. This paper reports a set of position statements presented in the plenary panel Part I in IEEE ICCI*CC'16 at Stanford University. The summary is contributed by invited panelists who are part of the world's renowned scholars in the transdisciplinary field of CI and CC.

[1]  Yingxu Wang,et al.  On Abstract Intelligence and Brain Informatics: Mapping Cognitive Functions of the Brain onto its Neural Structures , 2012, Int. J. Cogn. Informatics Nat. Intell..

[2]  Shushma Patel,et al.  A layered reference model of the brain (LRMB) , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[3]  Nicoletta Calzolari,et al.  Tools and Methods for Computational Lexicology , 1987, Comput. Linguistics.

[4]  Geoffrey E. Hinton,et al.  The "wake-sleep" algorithm for unsupervised neural networks. , 1995, Science.

[5]  Marina L. Gavrilova,et al.  Mining Social Behavioral Biometrics in Twitter , 2014, 2014 International Conference on Cyberworlds.

[6]  Rodolfo A. Fiorini,et al.  A Cybernetics Update for Competitive Deep Learning System , 2015 .

[7]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Lu Yang,et al.  Tree structured data processing on GPUs , 2017, 2017 7th International Conference on Cloud Computing, Data Science & Engineering - Confluence.

[9]  Shusaku Tsumoto,et al.  Abstract Intelligence: Embodying and Enabling Cognitive Systems by Mathematical Engineering , 2017, Int. J. Cogn. Informatics Nat. Intell..

[10]  D. Kahneman.  Thinking, Fast and Slow , 2011 .

[11]  Yingxu Wang,et al.  The OAR Model of Neural Informatics for Internal Knowledge Representation in the Brain , 2007, Int. J. Cogn. Informatics Nat. Intell..

[12]  MengChu Zhou,et al.  Short-Term Schedulability Analysis of Multiple Distiller Crude Oil Operations in Refinery With Oil Residency Time Constraint , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Edward A. Bender,et al.  Mathematical methods in artificial intelligence , 1996 .

[14]  Alessandro Perina,et al.  Personal Aesthetics for Soft Biometrics: A Generative Multi-resolution Approach , 2014, ICMI.

[15]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[16]  Yingxu Wang,et al.  Paradigms of Denotational Mathematics for Cognitive Informatics and Cognitive Computing , 2009, Fundam. Informaticae.

[17]  Yingxu Wang,et al.  The Cognitive Process of Decision Making , 2007, Int. J. Cogn. Informatics Nat. Intell..

[18]  Fernand Gobet,et al.  Chunking mechanisms and learning , 2012 .

[19]  B. Widrow,et al.  "Cognitive" memory , 2013, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[20]  Lotfi A. Zadeh,et al.  Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic , 1997, Fuzzy Sets Syst..

[21]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[22]  Rodolfo A. Fiorini,et al.  How Random is Your Tomographic Noise? A Number Theoretic Transform (NTT) Approach , 2014, Fundam. Informaticae.

[23]  Harold Boley,et al.  A fuzzy structure similarity algorithm for attributed generalized trees , 2014, 2014 IEEE 13th International Conference on Cognitive Informatics and Cognitive Computing.

[24]  Bernard Widrow,et al.  The No-Prop algorithm: A new learning algorithm for multilayer neural networks , 2013, Neural Networks.

[25]  Marina L. Gavrilova,et al.  Problems of Human-Computer Interaction in Cyberworlds , 2016, Trans. Comput. Sci..

[26]  Yingxu Wang,et al.  On Semantic Algebra: A Denotational Mathematics for Natural Language Comprehension and Cognitive Computing , 2013 .

[27]  Harold Boley,et al.  Structure Similarity of Attributed Generalized Trees , 2014, 2014 IEEE International Conference on Semantic Computing.

[28]  Yingxu Wang.  On the Mathematical Theories and Cognitive Foundations of Information , 2015, Int. J. Cogn. Informatics Nat. Intell..

[29]  Bernard Widrow,et al.  The Hebbian-LMS Learning Algorithm , 2015, IEEE Computational Intelligence Magazine.

[30]  D. Reisberg.  Cognition: Exploring the Science of the Mind , 2001 .

[31]  Yingxu Wang,et al.  Formal Relational Rules of English Syntax for Cognitive Linguistics, Machine Learning, and Cognitive Computing , 2013 .

[32]  Yingxu Wang,et al.  Semantic Manipulations and Formal Ontology for Machine Learning based on Concept Algebra , 2011, Int. J. Cogn. Informatics Nat. Intell..

[33]  Yingxu Wang,et al.  The Real-Time Process Algebra (RTPA) , 2002, Ann. Softw. Eng..

[34]  Yingxu Wang,et al.  On Cognitive Computing , 2009, Int. J. Softw. Sci. Comput. Intell..

[35]  Jürgen Schmidhuber,et al.  LSTM recurrent networks learn simple context-free and context-sensitive languages , 2001, IEEE Trans. Neural Networks.

[36]  Marina L. Gavrilova,et al.  Situation awareness of cancelable biometric system , 2013, The Visual Computer.

[37]  Ichiro Takeuchi,et al.  Multiple Incremental Decremental Learning of Support Vector Machines , 2009, IEEE Transactions on Neural Networks.

[38]  Marina L. Gavrilova,et al.  Artimetrics: Biometrics for Artificial Entities , 2012, IEEE Robotics & Automation Magazine.

[39]  Yingxu Wang,et al.  On Contemporary Denotational Mathematics for Computational Intelligence , 2008, Trans. Comput. Sci..

[40]  Yingxu Wang,et al.  Contemporary Cybernetics and Its Facets of Cognitive Informatics and Computational Intelligence , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[41]  Philippe Gaussier,et al.  Development of First Social Referencing Skills: Emotional Interaction as a Way to Regulate Robot Behavior , 2014, IEEE Transactions on Autonomous Mental Development.

[42]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[43]  John R. Anderson.  The Architecture of Cognition , 1983 .

[44]  Phillip C.-Y. Sheu.  Semantic Computing , 2008, Intelligent Information Processing.

[45]  Yingxu Wang,et al.  On Abstract Intelligence: Toward a Unifying Theory of Natural, Artificial, Machinable, and Computational Intelligence , 2009, Int. J. Softw. Sci. Comput. Intell..

[46]  Yingxu Wang.  Big Data Algebra (BDA): A Denotational Mathematical Structure for Big Data Science and Engineering , 2016 .

[47]  Paul Cook,et al.  A Word Embedding Approach to Identifying Verb-Noun Idiomatic Combinations , 2016, MWE@ACL.

[48]  Yingxu Wang.  Inference Algebra (IA): A Denotational Mathematics for Cognitive Computing and Machine Reasoning (I) , 2011, Int. J. Cogn. Informatics Nat. Intell..

[49]  Hao Wang,et al.  The Russo–Dye theorem in nest subalgebras of factors , 2015 .

[50]  Bernard Widrow.  Hebbian learning and the LMS algorithm , 2016, 2016 IEEE 15th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC).

[51]  Christine W. Chan,et al.  Part 4b: Application of data modeling and analysis techniques to the CO2 capture process system , 2012 .

[52]  Lotfi A. Zadeh.  A key issue of semantics of information , 2016, 2016 IEEE 15th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC).

[53]  Yingxu Wang.  Engineering Foundations of Software Engineering , 2007 .

[54]  Leen-Kiat Soh,et al.  Modeling Self-Efficacy as a Dynamic Cognitive Process with the Computational-Unified Learning Model (C-ULM): Implications for Cognitive Informatics and Cognitive Computing , 2015, Int. J. Cogn. Informatics Nat. Intell..

[55]  David W. Brooks,et al.  The Unified Learning Model: How Motivational, Cognitive, and Neurobiological Sciences Inform Best Teaching Practices , 2009 .

[56]  Vince D. Calhoun,et al.  Multimodal Data Fusion Using Source Separation: Application to Medical Imaging , 2015, Proceedings of the IEEE.

[57]  Yingxu Wang,et al.  Cognitive informatics models of the brain , 2006, IEEE Trans. Syst. Man Cybern. Syst..

[58]  Witold Pedrycz,et al.  A Doctrine of Cognitive Informatics (CI) , 2009, Fundam. Informaticae.

[59]  Yingxu Wang.  Neuroinformatics Models of Human Memory: Mapping the Cognitive Functions of Memory onto Neurophysiological Structures of the Brain , 2013, Int. J. Cogn. Informatics Nat. Intell..

[60]  Virendrakumar C. Bhavsar,et al.  High performance natural language processing services on the GARUDA grid , 2013, 2013 National Conference on Parallel Computing Technologies (PARCOMPTECH).

[61]  Marina L. Gavrilova,et al.  Soft biometric: Give me your favorite images and i will tell your gender , 2016, 2016 IEEE 15th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC).

[62]  F. Attneave,et al.  The Organization of Behavior: A Neuropsychological Theory , 1949 .

[63]  Marina L. Gavrilova,et al.  Editing Behavior to Recognize Authors of Crowdsourced Content , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[64]  Yingxu Wang,et al.  In Search of Denotational Mathematics: Novel Mathematical Means for Contemporary Intelligence, Brain, and Knowledge Sciences , 2012 .

[65]  Jan Peters,et al.  Imitation and Reinforcement Learning , 2010, IEEE Robotics & Automation Magazine.

[66]  Harold Boley,et al.  Range Similarity and Satisfaction Measures for Buyers and Sellers in E-marketplaces , 2008 .

[67]  Yingxu Wang.  Cognitive robotics and mathematical engineering , 2015, ICCI*CC.

[68]  Virendrakumar C. Bhavsar,et al.  Translation Memory for a Machine Translation System Using the Hadoop Framework , 2014, 2014 Fourth International Conference on Advances in Computing and Communications.

[69]  Yingxu Wang,et al.  Towards a Formal Framework of Cognitive Linguistics , 2012 .

[70]  Thomas G. Dietterich,et al.  Structured machine learning: the next ten years , 2008, Machine Learning.

[71]  L. A. Zadeh,et al.  Fuzzy logic and approximate reasoning , 1975, Synthese.

[72]  Yingxu Wang,et al.  On Cognitive Foundations and Mathematical Theories of Knowledge Science , 2016, Int. J. Cogn. Informatics Nat. Intell..

[73]  Yingxu Wang,et al.  Cognitive Informatics and Computational Intelligence: From Information Revolution to Intelligence Revolution , 2015, Int. J. Softw. Sci. Comput. Intell..

[74]  Harold Boley,et al.  A match-making system for learners and learning objects , 2005, Interact. Technol. Smart Educ..

[75]  Harold Boley,et al.  Semantic computing of simplicity in attributed generalized trees , 2016, 2016 IEEE 15th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC).

[76]  Rodolfo A. Fiorini,et al.  Deep learning and deep thinking: New application framework by CICT , 2016, 2016 IEEE 15th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC).

[77]  Lotfi A. Zadeh,et al.  From Computing with Numbers to Computing with Words - from Manipulation of Measurements to Manipulation of Perceptions , 2005, Logic, Thought and Action.

[78]  Robert A. Wilson,et al.  Book Reviews: The MIT Encyclopedia of the Cognitive Sciences , 2000, CL.

[79]  Marina L. Gavrilova,et al.  Social Behavioral Biometrics: An Emerging Trend , 2015, Int. J. Pattern Recognit. Artif. Intell..

[80]  Yingxu Wang,et al.  Welcome to the Journal of Advanced Mathematics and Applications Contemporary Mathematics as a Metamethodology of Science, Engineering, Society, and Humanity , 2012 .

[81]  Harold Boley,et al.  Combined Structure-Weight Graph Similarity and its Application in E-Health , 2013, CSWS.

[82]  Harold Boley,et al.  A Weighted‐Tree Similarity Algorithm for Multi‐Agent Systems in E‐Business Environments , 2004, Comput. Intell..

[83]  Jun Morimoto.  Robot Learning in Practice [From the Guest Editors] , 2010 .

[84]  Yingxu Wang,et al.  Editorial Recent Advances in Cognitive Informatics , 2006, IEEE Trans. Syst. Man Cybern. Syst..

[85]  Yingxu Wang.  Towards the Synergy of Cognitive Informatics, Neural Informatics, Brain Informatics, and Cognitive Computing , 2011, Int. J. Cogn. Informatics Nat. Intell..

[86]  Yingxu Wang,et al.  Towards the abstract system theory of system science for cognitive and intelligent systems , 2015, Complex & Intelligent Systems.

[87]  Yingxu Wang,et al.  Cognitive Learning Methodologies for Brain-Inspired Cognitive Robotics , 2015, Int. J. Cogn. Informatics Nat. Intell..

[88]  Yingxu Wang,et al.  Software Engineering Foundations: A Software Science Perspective , 2007 .

[89]  Yingxu Wang,et al.  Software Science: On the General Mathematical Models and Formal Properties of Software , 2014 .

[90]  Yingxu Wang,et al.  Advances in Cognitive Informatics and Cognitive Computing , 2010 .

[91]  Yingxu Wang.  Cognitive Informatics: Towards Future Generation Computers that Think and Feel , 2006, 2006 5th IEEE International Conference on Cognitive Informatics.

[92]  Yingxu Wang,et al.  On Neuroinformatics: Mathematical Models of Neuroscience and Neurocomputing , 2012 .

[93]  Ameet Talwalkar,et al.  Foundations of Machine Learning , 2012, Adaptive computation and machine learning.

[94]  Marina L. Gavrilova,et al.  Identifying Users from Online Interactions in Twitter , 2016, Trans. Comput. Sci..

[95]  Randy Goebel,et al.  Computational intelligence - a logical approach , 1998 .

[96]  Yingxu Wang.  On a Novel Cognitive Knowledge Base (CKB) for Cognitive Robots and Machine Learning , 2014, Int. J. Softw. Sci. Comput. Intell..

[97]  Rodolfo A. Fiorini,et al.  Computerized Tomography Noise Reduction by CICT Optimized Exponential Cyclic Sequences (OECS) Co-domain , 2015, Fundam. Informaticae.

[98]  Ujjwal Maulik,et al.  Integrating Clustering and Supervised Learning for Categorical Data Analysis , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[99]  A. Moors.  Automaticity: Componential, Causal, and Mechanistic Explanations. , 2016, Annual review of psychology.

[100]  Yingxu Wang,et al.  On Formal and Cognitive Semantics for Semantic Computing , 2010, Int. J. Semantic Comput..

[101]  Yingxu Wang,et al.  The Theoretical Framework of Cognitive Informatics , 2007, Int. J. Cogn. Informatics Nat. Intell..

[102]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[103]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[104]  Lotfi A. Zadeh,et al.  Precisiated Natural Language (PNL) , 2004, AI Mag..

[105]  Harold Boley,et al.  Matchmaking in p2p e-marketplaces: soft constraints and compromise matching , 2010, ICEC '10.

[106]  Witold Pedrycz,et al.  Cognitive Informatics and Cognitive Computing in Year 10 and Beyond , 2011, Int. J. Cogn. Informatics Nat. Intell..

[107]  Yingxu Wang,et al.  Deep reasoning and thinking beyond deep learning by cognitive robots and brain-inspired systems , 2016, 2016 IEEE 15th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC).

[108]  Leen-Kiat Soh,et al.  Modeling chunking effects on learning and performance using the Computational-Unified Learning Model (C-ULM): A multiagent cognitive process model , 2016, 2016 IEEE 15th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC).

[109]  Marina L. Gavrilova,et al.  A Concept of Social Behavioral Biometrics: Motivation, Current Developments, and Future Trends , 2014, 2014 International Conference on Cyberworlds.

[110]  Harold Boley,et al.  Similarity of Attributed Generalized Tree Structures: A Comparative Study , 2015, SISAP.

[111]  Virendrakumar C. Bhavsar,et al.  Parallel implementation of machine translation using MPJ Express , 2013, 2013 National Conference on Parallel Computing Technologies (PARCOMPTECH).

[112]  Yingxu Wang,et al.  Quantitative Semantic Analysis and Comprehension by Cognitive Machine Learning , 2016, Int. J. Cogn. Informatics Nat. Intell..

[113]  Chris C. Shaw.  Dimensions in Medical Imaging: The More the Better? [Point of View] , 2010, Proc. IEEE.

[114]  Yingxu Wang,et al.  On Denotational Mathematics Foundations for the Next Generation of Computers: Cognitive Computers for Knowledge Processing , 2012 .

[115]  Virendrakumar C. Bhavsar,et al.  Vishit: A Visualizer for Hindi Text , 2014, 2014 Fourth International Conference on Communication Systems and Network Technologies.

[116]  Yingxu Wang.  On Cognitive Informatics , 2003 .