Science as By-Products of Search for Novel Patterns , or Data Compressible in Unknown Yet Learnable Ways

I argue that science, art, music, comedy are just by-product s of our intrinsic desire to create / discover more novel patterns , that is, data compressible in hitherto unknown ways. It is possible to rigorously formalize this co n ept and implement it on learning machines, thus building artificial robotic scie ntists and artists equipped with intrinsically motivated curiosity and creativity. I s ummarize our work on this topic since 1990; for concrete implementation details (199 0-2009) see [17, 16, 30,

[1]  David A. Huffman,et al.  A method for the construction of minimum-redundancy codes , 1952, Proceedings of the IRE.

[2]  H. Frank.  Kybernetische Analysen : subjektiver Sachverhalte , 1964 .

[3]  W. Stolz.  Information Theory and Esthetic Perception. , 1967 .

[4]  W. J. Studden,et al.  Theory Of Optimal Experiments , 1972 .

[5]  H. Franke,et al.  Ästhetik als Informationsverarbeitung , 1974 .

[6]  Benoit B. Mandelbrot,et al.  Fractal Geometry of Nature , 1984 .

[7]  Jürgen Schmidhuber,et al.  A possibility for implementing curiosity and boredom in model-building neural controllers , 1991 .

[8]  Jürgen Schmidhuber,et al.  Curious model-building control systems , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[9]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[10]  S. Hochreiter,et al.  REINFORCEMENT DRIVEN INFORMATION ACQUISITION IN NONDETERMINISTIC ENVIRONMENTS , 1995 .

[11]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[12]  Jürgen Schmidhuber,et al.  Low-Complexity Art , 2017 .

[13]  K. Popper.  All life is problem solving , 1997 .

[14]  Jürgen Schmidhuber,et al.  Exploring the predictable , 2003 .

[15]  Nuttapong Chentanez,et al.  Intrinsically Motivated Reinforcement Learning , 2004, NIPS.

[16]  Marcus Hutter.  Simulation Algorithms for Computational Systems Biology , 2017, Texts in Theoretical Computer Science. An EATCS Series.

[17]  Jürgen Schmidhuber,et al.  Developmental robotics, optimal artificial curiosity, creativity, music, and the fine arts , 2006, Connect. Sci..

[18]  Jürgen Schmidhuber,et al.  Simple Algorithmic Principles of Discovery, Subjective Beauty, Selective Attention, Curiosity & Creativity , 2007, Discovery Science.

[19]  P. Vitányi,et al.  An Introduction to Kolmogorov Complexity and Its Applications, Third Edition , 1997, Texts in Computer Science.

[20]  Jürgen Schmidhuber,et al.  Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes , 2008, ABiALS.

[21]  Jürgen Schmidhuber,et al.  Simple algorithmic theory of subjective beauty, novelty, surprise, interestingness, attention, curiosity, creativity, art, science, music, jokes (特集 高次機能の学習と創発--脳・ロボット・人間研究における新たな展開) , 2009 .

[22]  Jürgen Schmidhuber,et al.  Ultimate Cognition à la Gödel , 2009, Cognitive Computation.