Distributed memory and the representation of general and specific information.

We describe a distributed model of information processing and memory and apply it to the representation of general and specific information. The model consists of a large number of simple processing elements which send excitatory and inhibitory signals to each other via modifiable connections. Information processing is thought of as the process whereby patterns of activation are formed over the units in the model through their excitatory and inhibitory interactions. The memory trace of a processing event is the change or increment to the strengths of the interconnections that results from the processing event. The traces of separate events are superimposed on each other in the values of the connection strengths that result from the entire set of traces stored in the memory. The model is applied to a number of findings related to the question of whether we store abstract representations or an enumeration of specific experiences in memory. The model simulates the results of a number of important experiments which have been taken as evidence for the enumeration of specific experiences. At the same time, it shows how the functional equivalent of abstract representations--prototypes, logogens, and even rules--can emerge from the superposition of traces of specific experiences, when the conditions are right for this to happen. In essence, the model captures the structure present in a set of input patterns; thus, it behaves as though it had learned prototypes or rules, to the extent that the structure of the environment it has learned about can be captured by describing it in terms of these abstractions.

[1]  William M. Smith,et al.  A Study of Thinking , 1956 .

[2]  A. A. Mullin,et al.  Principles of neurodynamics , 1962 .

[3]  Eugene Galanter,et al.  Handbook of mathematical psychology: I. , 1963 .

[4]  Eric H. Lenneberg,et al.  New directions in the study of language , 1964 .

[5]  P. Ostwald New Directions in the Study of Language , 1965 .

[6]  M. Posner,et al.  On the genesis of abstract ideas. , 1968, Journal of experimental psychology.

[7]  M. Posner,et al.  Retention of Abstract Ideas. , 1970 .

[8]  Patrick Henry Winston,et al.  Learning structural descriptions from examples , 1970 .

[9]  E. Tulving,et al.  Episodic and semantic memory , 1972 .

[10]  E. Tulving,et al.  Organization of memory. , 1973 .

[11]  I. N. Veselovskij On the genesis of , 1973 .

[12]  R. F. Thompson,et al.  The search for the engram. , 1976, The American psychologist.

[13]  Patrick Henry Winston,et al.  The psychology of computer vision , 1976, Pattern Recognit..

[14]  Stephen A. Ritz,et al.  Distinctive features, categorical perception, and probability learning: some applications of a neural model , 1977 .

[15]  S. Kuczaj The acquisition of regular and irregular past tense forms , 1977 .

[16]  Teuvo Kohonen,et al.  Associative memory. A system-theoretical approach , 1977 .

[17]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[18]  W A Wickelgren,et al.  Chunking and consolidation: a theoretical synthesis of semantic networks, configuring in conditioning, S--R versus congenitive learning, normal forgetting, the amnesic syndrome, and the hippocampal arousal system. , 1979, Psychological review.

[19]  E. Rosch,et al.  Cognition and Categorization , 1980 .

[20]  James L. McClelland On the time relations of mental processes: An examination of systems of processes in cascade. , 1979 .

[21]  R. Glushko The Organization and Activation of Orthographic Knowledge in Reading Aloud. , 1979 .

[22]  Paul A. Kolers,et al.  Processing of visible language , 1979 .

[23]  John Morton,et al.  Facilitation in Word Recognition: Experiments Causing Change in the Logogen Model , 1979 .

[24]  John R. Anderson,et al.  Journal of Experimental Psychology: Human Learning and Memory Evidence against a Semantic-episodic Distinction £-john R. Necessarily a Functional One, It Has Often , 2022 .

[25]  B. Fischhoff,et al.  Journal of Experimental Psychology: Human Learning and Memory , 1980 .

[26]  David E. Rumelhart,et al.  An Interactive Activation Model of the Effect of Context in Perception. Part 2 , 1980 .

[27]  Charles A. Perfetti,et al.  Interactive Processes in Reading , 1981 .

[28]  Geoffrey E. Hinton A Parallel Computation that Assigns Canonical Object-Based Frames of Reference , 1981, IJCAI.

[29]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[30]  Teuvo Kohonen,et al.  Storage and Processing of Information in Distributed Associative Memory Systems , 1981 .

[31]  D. Medin,et al.  Linear separability in classification learning. , 1981 .

[32]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[33]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: Part 2. The contextual enhancement effect and some tests and extensions of the model. , 1982, Psychological review.

[34]  J. Eich A composite holographic associative recall model. , 1982 .

[35]  B. Murdock A Theory for the Storage and Retrieval of Item and Associative Information. , 1982 .

[36]  L. Jacoby Remembering the data: analyzing interactive processes in reading , 1983 .

[37]  R M Shiffrin,et al.  Episodic and lexical contributions to the repetition effect in word identification. , 1983, Journal of experimental psychology. General.

[38]  James A. Anderson,et al.  Cognitive and psychological computation with neural models , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[39]  L. Jacoby Perceptual enhancement: persistent effects of an experience. , 1983, Journal of experimental psychology. Learning, memory, and cognition.

[40]  J.A. Anderson,et al.  Theory of categorization based on distributed memory storage. , 1984 .

[41]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[42]  David Zipser,et al.  Feature Discovery by Competive Learning , 1986, Cogn. Sci..

[43]  James L. McClelland Putting Knowledge in its Place: A Scheme for Programming Parallel Processing Structures on the Fly , 1988, Cogn. Sci..

[44]  A. Salasoo,et al.  Building permanent memory codes: codification and repetition effects in word identification. , 1985, Journal of experimental psychology. General.

[45]  Douglas L. Hintzman,et al.  "Schema Abstraction" in a Multiple-Trace Memory Model , 1986 .

[46]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .