Steps toward Artificial Intelligence

The problems of heuristic programming-of making computers solve really difficult problems-are divided into five main areas: Search, Pattern-Recognition, Learning, Planning, and Induction. A computer can do, in a sense, only what it is told to do. But even when we do not know how to solve a certain problem, we may program a machine (computer) to Search through some large space of solution attempts. Unfortunately, this usually leads to an enormously inefficient process. With Pattern-Recognition techniques, efficiency can often be improved, by restricting the application of the machine's methods to appropriate problems. Pattern-Recognition, together with Learning, can be used to exploit generalizations based on accumulated experience, further reducing search. By analyzing the situation, using Planning methods, we may obtain a fundamental improvement by replacing the given search with a much smaller, more appropriate exploration. To manage broad classes of problems, machines will need to construct models of their environments, using some scheme for Induction. Wherever appropriate, the discussion is supported by extensive citation of the literature and by descriptions of a few of the most successful heuristic (problem-solving) programs constructed to date.

[1]  J. H. Holland,et al.  On Iterative Circuit Computers Constructed of Microelectronic Components and Systems , 1899 .

[2]  Allen Newell,et al.  Empirical Explorations Of The Logic Theory Machine, A Case Study In Heuristic , 1899 .

[3]  Gary R Lichtenstein [Letter to the Editor] , 1996, Nature.

[4]  W. H. F. Barnes The Nature of Explanation , 1944, Nature.

[5]  W. Pitts,et al.  How we know universals; the perception of auditory and visual forms. , 1947, The Bulletin of mathematical biophysics.

[6]  Claude E. Shannon,et al.  The synthesis of two-terminal switching circuits , 1949, Bell Syst. Tech. J..

[7]  R. R. Bush,et al.  A mathematical model for simple learning. , 1951, Psychological review.

[8]  H. Evans The Study of Instinct , 1952 .

[9]  M. Mead,et al.  Cybernetics , 1953, The Yale Journal of Biology and Medicine.

[10]  D. C. Dashfield HER MAJESTY'S STATIONERY OFFICE , 1954 .

[11]  J. Pierce The Proceedings of the IRE , 1954, Proceedings of the IRE.

[12]  W. A. Clark,et al.  Simulation of self-organizing systems by digital computer , 1954, Trans. IRE Prof. Group Inf. Theory.

[13]  W. McCulloch THROUGH THE DEN OF THE METAPHYSICIAN* , 1954, The British Journal for the Philosophy of Science.

[14]  M. Kneale,et al.  The Sensory Order , 1954 .

[15]  Claude E. Shannon,et al.  Game playing machines , 1955 .

[16]  O. G. Selfridge,et al.  Pattern recognition and modern computers , 1899, AFIPS '55 (Western).

[17]  G. P. Dinneen Programming pattern recognition , 1955, AFIPS '55 (Western).

[18]  D. Mackay The Epistemological Problem for Automata , 1956 .

[19]  W. Ross Ashby,et al.  Design for an Intelligence-Amplifier , 1956 .

[20]  John H. Holland,et al.  Tests on a cell assembly theory of the action of the brain, using a large digital computer , 1956, IRE Trans. Inf. Theory.

[21]  C. Mooers ZATOCODING AND DEVELOPMENTS IN INFORMATION RETRIEVAL , 1956 .

[22]  A. M. Uttley,et al.  Temporal and Spatial Patterns in a Conditional Probability Machine , 1956 .

[23]  John McCarthy,et al.  The Inversion of Functions Defined by Turing Machines , 1956 .

[24]  William M. Smith,et al.  A Study of Thinking , 1956 .

[25]  Sundaram Seshu,et al.  The Theory of Nets , 1957, IRE Trans. Electron. Comput..

[26]  J. C. Shaw,et al.  Empirical explorations of the logic theory machine: a case study in heuristic , 1899, IRE-AIEE-ACM '57 (Western).

[27]  R. A. Kirsch,et al.  Experiments in processing pictorial information with a digital computer , 1899, IRE-ACM-AIEE '57 (Eastern).

[28]  Allen Newell,et al.  Elements of a theory of human problem solving. , 1958 .

[29]  Nathaniel Rochester,et al.  Intelligent Behavior in Problem-Solving Machines , 1958, IBM J. Res. Dev..

[30]  George A. Miller,et al.  Finite State Languages , 1958, Inf. Control..

[31]  A. Bernstein,et al.  A chess playing program for the IBM 704 , 1899, IRE-ACM-AIEE '58 (Western).

[32]  Richard M. Friedberg,et al.  A Learning Machine: Part I , 1958, IBM J. Res. Dev..

[33]  Allen Newell,et al.  Chess-Playing Programs and the Problem of Complexity , 1958, IBM J. Res. Dev..

[34]  H. Sherman,et al.  A quasi-topological method for the recognition of line patterns , 1959, IFIP Congress.

[35]  S. H. Unger,et al.  Pattern Detection and Recognition , 1959, Proceedings of the IRE.

[36]  Ray J. Solomonoff,et al.  A new method for discovering the grammars of phrase structure languages , 1959, IFIP Congress.

[37]  Richard L. Grimsdale,et al.  A system for the automatic recognition of patterns , 1959 .

[38]  Richard M. Friedberg,et al.  A Learning Machine: Part II , 1959, IBM J. Res. Dev..

[39]  Allen Newell,et al.  Report on a general problem-solving program , 1959, IFIP Congress.

[40]  W. Pitts,et al.  What the Frog's Eye Tells the Frog's Brain , 1959, Proceedings of the IRE.

[41]  Arthur L. Samuel,et al.  Some Studies in Machine Learning Using the Game of Checkers , 1967, IBM J. Res. Dev..

[42]  J. S. Bomba,et al.  Alpha-numeric character recognition using local operations , 1959, IRE-AIEE-ACM '59 (Eastern).

[43]  W. W. Bledsoe,et al.  Pattern recognition and reading by machine , 1959, IRE-AIEE-ACM '59 (Eastern).

[44]  Saul Gorn,et al.  On the Mechanical Simulation of Habit-Forming and Learning , 1959, Inf. Control..

[45]  Allen Newell,et al.  An introduction to information processing language V , 1960, Commun. ACM.

[46]  Hao Wang,et al.  Toward Mechanical Mathematics , 1960, IBM J. Res. Dev..

[47]  John McCarthy,et al.  Programs with common sense , 1960 .

[48]  Worthie Doyle,et al.  Recognition of sloppy, hand-printed characters , 1960, IRE-AIEE-ACM '60 (Western).

[49]  Hilary Putnam,et al.  A Computing Procedure for Quantification Theory , 1960, JACM.

[50]  J. R. Newman,et al.  Gödel's Proof , 1961 .

[51]  Oliver G. Selfridge,et al.  Pattern recognition by machine , 1960 .

[52]  Martin Shubik,et al.  Games Decisions and Industrial Organization , 1960 .

[53]  Wilbur H. Highleyman,et al.  Comments on a Character Recognition Method of Bledsoe and Browning , 1960, IRE Trans. Electron. Comput..

[54]  Hao Wang,et al.  Proving theorems by pattern recognition I , 1960, Commun. ACM.

[55]  Kenneth L. Artis Design for a Brain , 1961 .

[56]  Marvin Minsky,et al.  A Selected Descriptor-Indexed Bibliography to the Literature on Artificial Intelligence , 1961 .

[57]  John M. Wozencraft,et al.  Coding for two-way channels , 1961 .

[58]  I. S. Gradshtein,et al.  THE ELEMENTS OF MATHEMATICAL LOGIC , 1963 .