Incorporating Latent Factors Into Knowledge Tracing To Predict Individual Differences In Learning

An effective tutor—human or electronic—must determine what a student does and does not know. Inferring a student’s knowledge state is challenging because behavioral observations (e.g., correct vs. incorrect problem solution) provide only weak evidence. Two classes of models have been proposed to address the challenge. Latent-factor models employ a collaborative filtering approach in which data from a population of students solving a population of problems is used to predict the performance of an individual student on a specific problem. Knowledgetracing models exploit a student’s sequence of problem-solving attempts to determine the point at which a skill is mastered. Although these two approaches are complementary, only preliminary, informal steps have been taken to integrate them. We propose a principled synthesis of the two approaches that predicts student performance based on a theory of individual differences among students and among problems, as well as a theory of the temporal dynamics of learning. We present promising results using data from two intelligent tutoring systems.

[1]  R. Atkinson Optimizing the Learning of a Second-Language Vocabulary. , 1972 .

[2]  Jim Reye,et al.  Student Modelling Based on Belief Networks , 2004, Int. J. Artif. Intell. Educ..

[3]  P. Boeck,et al.  Explanatory item response models : a generalized linear and nonlinear approach , 2004 .

[4]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[5]  Kenneth R. Koedinger,et al.  Learning Factors Analysis - A General Method for Cognitive Model Evaluation and Improvement , 2006, Intelligent Tutoring Systems.

[6]  J. Beck Difficulties in inferring student knowledge from observations ( and why you should care ) , 2007 .

[7]  Joseph E. Beck,et al.  Identifiability: A Fundamental Problem of Student Modeling , 2007, User Modeling.

[8]  Vincent Aleven,et al.  More Accurate Student Modeling through Contextual Estimation of Slip and Guess Probabilities in Bayesian Knowledge Tracing , 2008, Intelligent Tutoring Systems.

[9]  Kenneth R. Koedinger,et al.  Comparing Two IRT Models for Conjunctive Skills , 2008, Intelligent Tutoring Systems.

[10]  Kenneth R. Koedinger,et al.  Performance Factors Analysis - A New Alternative to Knowledge Tracing , 2009, AIED.

[11]  Kenneth R. Koedinger,et al.  Generalized learning factors analysis: improving cognitive models with machine learning , 2009 .

[12]  Shou-De Lin,et al.  Feature Engineering and Classifier Ensemble for KDD Cup 2010 , 2010, KDD 2010.

[13]  Zachary A. Pardos,et al.  Modeling Individualization in a Bayesian Networks Implementation of Knowledge Tracing , 2010, UMAP.

[14]  Ryan Shaun Joazeiro de Baker,et al.  Contextual Slip and Prediction of Student Performance after Use of an Intelligent Tutor , 2010, UMAP.

[15]  Kenneth R. Koedinger,et al.  A Data Repository for the EDM Community: The PSLC DataShop , 2010 .

[16]  Kurt VanLehn,et al.  Instructional Factors Analysis: A Cognitive Model For Multiple Instructional Interventions , 2011, EDM.

[17]  Zachary A. Pardos,et al.  Clustered Knowledge Tracing , 2012, ITS.