Forgetting of Foreign-Language Skills: A Corpus-Based Analysis of Online Tutoring Software

We explore the nature of forgetting in a corpus of 125,000 students learning Spanish using the Rosetta Stone® foreign-language instruction software across 48 lessons. Students are tested on a lesson after its initial study and are then retested after a variable time lag. We observe forgetting consistent with power function decay at a rate that varies across lessons but not across students. We find that lessons which are better learned initially are forgotten more slowly, a correlation which likely reflects a latent cause such as the quality or difficulty of the lesson. We obtain improved predictive accuracy of the forgetting model by augmenting it with features that encode characteristics of a student's initial study of the lesson and the activities the student engaged in between the initial and delayed tests. The augmented model can predict 23.9% of the variance in an individual's score on the delayed test. We analyze which features best explain individual performance.

[1]  Robert A. Bjork,et al.  Optimum rehearsal patterns and name learning , 1978 .

[2]  Michael C. Mozer,et al.  Automatic Discovery of Cognitive Skills to Improve the Prediction of Student Learning , 2014, NIPS.

[3]  W. A. Wickelgren Single-trace fragility theory of memory dynamics , 1974, Memory & cognition.

[4]  H. P. Bahrick,et al.  Fifty years of memory for names and faces: A cross-sectional approach. , 1975 .

[5]  Harold Pashler,et al.  Retrieval practice over the long term: Should spacing be expanding or equal-interval? , 2014, Psychonomic bulletin & review.

[6]  Hermann Ebbinghaus (1885) Memory: A Contribution to Experimental Psychology , 2013, Annals of Neurosciences.

[7]  Robert V. Lindsey,et al.  Improving Students’ Long-Term Knowledge Retention Through Personalized Review , 2014, Psychological science.

[8]  G. Miller,et al.  Cognitive science. , 1981, Science.

[9]  Harry P. Bahrick,et al.  Lifetime maintenance of high school mathematics content. , 1991 .

[10]  Harold Pashler,et al.  The Effect of Overlearning on Long-Term Retention , 2005 .

[11]  Michael C. Mozer,et al.  Predicting and Improving Memory Retention: Psychological Theory Matters in the Big Data Era , 2016 .

[12]  Veronica X. Yan,et al.  Do students think that difficult or valuable materials should be restudied sooner rather than later? , 2013, Journal of experimental psychology. Learning, memory, and cognition.

[13]  Michael C. Mozer,et al.  Maximizing Students' Retention Via Spaced Review: Practical Guidance From Computational Models Of Memory , 2013, CogSci.

[14]  J. Wixted,et al.  On the Form of Forgetting , 1991 .

[15]  D. Rubin,et al.  One Hundred Years of Forgetting : A Quantitative Description of Retention , 1996 .

[16]  Deniz Senturk-Doganaksoy,et al.  Explanatory Item Response Models: A Generalized Linear and Nonlinear Approach , 2006, Technometrics.

[17]  J. Wixted On Common Ground: Jost's (1897) law of forgetting and Ribot's (1881) law of retrograde amnesia. , 2004, Psychological review.

[18]  E. Custers,et al.  Very long‐term retention of basic science knowledge in doctors after graduation , 2011, Medical education.

[19]  H. P. Bahrick The Cognitive Map of a City: Fifty Years of Learning and Memory , 1983 .

[20]  J. Wixted,et al.  Genuine power curves in forgetting: A quantitative analysis of individual subject forgetting functions , 1997, Memory & cognition.

[21]  T. O. Nelson,et al.  When People's Judgments of Learning (JOLs) are Extremely Accurate at Predicting Subsequent Recall: The “Delayed-JOL Effect” , 1991 .

[22]  H. P. Bahrick Semantic memory content in permastore: fifty years of memory for Spanish learned in school. , 1984, Journal of experimental psychology. General.

[23]  E. Custers Long-term retention of basic science knowledge: a review study , 2010, Advances in health sciences education : theory and practice.

[24]  Shana K. Carpenter,et al.  The Wickelgren Power Law and the Ebbinghaus Savings Function , 2007, Psychological science.

[25]  R. Bjork Memory and metamemory considerations in the training of human beings. , 1994 .

[26]  John R Anderson,et al.  Using a model to compute the optimal schedule of practice. , 2008, Journal of experimental psychology. Applied.

[27]  M. Masson Using confidence intervals for graphically based data interpretation. , 2003, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.