The validity of verbal protocols

The reactivity of a “think aloud” verbal protocol and the veridicality of different retrospective protocols were tested over four dissimilar tasks. Generating a concurrent protocol altered accuracy in two tasks, simple addition and a choice between two gambles, and generally prolonged response times. Such reactivity partially qualifies the dominant theory of protocol generation (Ericsson & Simon, 1984). Retrospective protocols yielded substantial forgetting or fabrication in all tasks, supporting the consensus on the nonveridicality of these methods. It is concluded that protocol validity should be based on an empirical check rather than on theory-based assurances.

[1]  Articulation in Automatic Mental Work , 1941 .

[2]  William G. Cochran,et al.  Experimental Designs, 2nd Edition , 1950 .

[3]  William G. Cochran,et al.  Experimental designs, 2nd ed. , 1957 .

[4]  Donald F. Dansereau,et al.  An information processing analysis of mental multiplication , 1966 .

[5]  L. Brooks.  Spatial and verbal components of the act of recall. , 1968 .

[6]  Donald F. Dansereau,et al.  An information processing model of mental multiplication. , 1969 .

[7]  Robert G. Crowder,et al.  The role of one's own voice in immediate memory ☆ , 1970 .

[8]  Phillip M. Tell.  Influence of vocalization on short-term memory , 1971 .

[9]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[10]  Michael H. Kutner.  Applied Linear Statistical Models , 1974 .

[11]  Catherine G. Penney,et al.  Modality effects in short-term verbal memory. , 1975 .

[12]  H. Simon,et al.  The functional equivalence of problem solving skills , 1975, Cognitive Psychology.

[13]  A. Kazdin.  Assessment of imagery during covert modeling of assertive behavior , 1976 .

[14]  J. Payne,et al.  Judgments about Crime and the Criminal , 1977 .

[15]  Daniel Gopher,et al.  On the Economy of the Human Processing System: A Model of Multiple Capacity. , 1977 .

[16]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[17]  Eliot R. Smith,et al.  Limits on perception of cognitive processes: A reply to Nisbett and Wilson. , 1978 .

[18]  J. Payne,et al.  Exploring predecisional behavior: An alternative approach to decision research , 1978 .

[19]  G. Hitch.  The role of short-term working memory in mental arithmetic , 1978, Cognitive Psychology.

[20]  J. Edward Russo,et al.  A software system for the collection of retrospective protocols prompted by eye fixations , 1979 .

[21]  Barton A. Weitz,et al.  Retrospective Self-Insight on Factors Considered in Product Evaluation , 1979 .

[22]  John R. Anderson,et al.  Further arguments concerning representations for mental imagery: A response to Hayes-Roth and Pylyshyn. , 1979 .

[23]  Christopher D. Wickens,et al.  The Structure of Attentional Resources , 1980 .

[24]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[25]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[26]  Peter Wright,et al.  Retrospective reports on the causes of decisions. , 1981 .

[27]  Introspection and causal accounts. , 1981 .

[28]  James B. Wilcox,et al.  How Valid are Product Descriptions and Protocols in Choice Experiments , 1981 .

[29]  David M. Schweiger,et al.  Is the simultaneous verbal protocol a viable method for studying managerial problem solving and decision making , 1983 .

[30]  B. Dosher,et al.  Strategies for multiattribute binary choice. , 1983, Journal of experimental psychology. Learning, memory, and cognition.

[31]  Eduard J. Fidler.  The Reliability and Validity of Concurrent, Retrospective, and Interpretive Verbal Reports: An Experimental Study , 1983 .

[32]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[33]  Mm. Liabre.  Standard Progressive Matrices , 1984 .

[34]  John W. Payne,et al.  Effort and Accuracy in Choice , 1985 .

[35]  George A. Quattrone.  On the congruity between internal states and action. , 1985 .

[36]  G D Logan,et al.  On the autonomy of mental processes: a case study of arithmetic. , 1986, Journal of experimental psychology. General.

[37]  J. I. Kim,et al.  Accountability and judgment processes in a personality prediction task. , 1987, Journal of personality and social psychology.

[38]  Barry H. Kantowitz,et al.  Mental Workload , 2020, Encyclopedia of Behavioral Medicine.

[39]  Charles K. Turner.  Don't Blame Memory for People's Faulty Reports on What Influences their Judgments , 1988 .

[40]  Gabriel J. Biehal,et al.  The Effects of Concurrent Verbalization on Choice Processing , 1989 .