Improving Intelligent Tutoring Systems: Using Expectation Maximization to Learn Student Skill Levels

This paper describes research to analyze students' initial skill level and to predict their hidden characteristics while working with an intelligent tutor. Based only on pre-test problems, a learned network was able to evaluate a students mastery of twelve geometry skills. This model will be used online by an Intelligent Tutoring System to dynamically determine a policy for individualizing selection of problems/hints, based on a students learning needs. Using Expectation Maximization, we learned the hidden parameters of several Bayesian networks that linked observed student actions with inferences about unobserved features. Bayesian Information Criterion was used to evaluate different skill models. The contribution of this work includes learning the parameters of the best network, whereas in previous work, the structure of a student model was fixed.

[1]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[2]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[3]  B. G. Quinn,et al.  The determination of the order of an autoregression , 1979 .

[4]  S. Chipman,et al.  Cognitively diagnostic assessment , 1995 .

[5]  John R. Anderson,et al.  Student modeling in the ACT Programming Tutor. , 1995 .

[6]  Nir Friedman,et al.  Learning Belief Networks in the Presence of Missing Values and Hidden Variables , 1997, ICML.

[7]  Sanford Weisberg,et al.  Computing science and statistics : proceedings of the 30th Symposium on the Interface, Minneapolis, Minnesota, May 13-16, 1998 : dimension reduction, computational complexity and information , 1998 .

[8]  Kevin Murphy,et al.  Bayes net toolbox for Matlab , 1999 .

[9]  Joseph E. Beck,et al.  ADVISOR: A Machine Learning Architecture for Intelligent Tutor Construction , 2000, AAAI/IAAI.

[10]  Joseph E. Beck,et al.  High-Level Student Modeling with Machine Learning , 2000, Intelligent Tutoring Systems.

[11]  P. Gehler,et al.  An introduction to graphical models , 2001 .

[12]  Antonija Mitrovic,et al.  Optimising ITS Behaviour with Bayesian Networks and Decision Theory , 2001 .

[13]  Beverly Park Woolf,et al.  Inferring Unobservable Learning Variables from Students' Help Seeking Behavior , 2004, Intelligent Tutoring Systems.

[14]  Jim Reye,et al.  Student Modelling Based on Belief Networks , 2004, Int. J. Artif. Intell. Educ..

[15]  ReyeJim.  Student Modelling Based on Belief Networks , 2004 .

[16]  Beverly Park Woolf,et al.  Web-Based Intelligent Multimedia Tutoring for High Stakes Achievement Tests , 2004, Intelligent Tutoring Systems.

[17]  Sridhar Mahadevan,et al.  Learning hierarchical models of activity , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[18]  Cristina Conati,et al.  Using Bayesian Networks to Manage Uncertainty in Student Modeling , 2002, User Modeling and User-Adapted Interaction.

[19]  Hasmik Mehranian,et al.  Evaluating the Feasibility of Learning Student Models from Data , 2005 .