An Intelligent Testing System Embedded With an Ant-Colony-Optimization-Based Test Composition Method

Computer-assisted testing systems are promising in generating tests efficiently and effectively for evaluating a person's skill. This paper develops a novel intelligent testing system for both teachers and students. Based on the browser/server structure, the proposed testing system comprises a question bank and five modules, offering the features of self-adaptation, reliability, and flexibility for generating parallel tests with identical test ability. The core of the developed system is the ant-colony-optimization-based test composition (ACO-TC) method, which aims at generating high-quality tests for examinations and satisfying multiple requirements. As an advanced computational intelligence algorithm, the proposed ACO-TC method uses a colony of ants to select appropriate questions from a question bank to construct solutions. Pheromone and heuristic information is designed for facilitating the ants' selection. The system is analyzed by composing tests in different situations. The generated tests not only match the expected total completion time, the concept proportions, the average difficulty, and the score proportions of different question types, but also have high average discrimination degrees of questions. The experimental results also show that the system can always generate high-quality tests from question banks with various sizes.

[1]  Alex Alves Freitas,et al.  Data mining with an ant colony optimization algorithm , 2002, IEEE Trans. Evol. Comput..

[2]  Alenka Kavcic,et al.  Fuzzy user modeling for adaptation in educational hypermedia , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[3]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[4]  Alice E. Smith,et al.  An ant colony optimization algorithm for the redundancy allocation problem (RAP) , 2004, IEEE Transactions on Reliability.

[5]  Alenka Kavÿÿ Fuzzy User Modeling for Adaptation in Educational Hypermedia , 2004 .

[6]  Chien Chou Constructing a computer-assisted testing and evaluation system on the World Wide Web-the CATES experience , 2000, IEEE Trans. Educ..

[7]  Andreas Sumper,et al.  A distance PLC programming course employing a remote laboratory based on a flexible manufacturing cell , 2006, IEEE Transactions on Education.

[8]  P. Lira,et al.  MULTITEST II: a program for the generation, correction, and analysis of multiple choice tests , 1990 .

[9]  Eduardo Guzmán,et al.  Self-assessment in a feasible, adaptive web-based testing system , 2005, IEEE Transactions on Education.

[10]  Thomas Stützle,et al.  Ant Colony Optimization , 2009, EMO.

[11]  G. W. Snedecor Statistical Methods , 1964 .

[12]  H.S.-H. Chung,et al.  Extended Ant Colony Optimization Algorithm for Power Electronic Circuit Design , 2009, IEEE Transactions on Power Electronics.

[13]  Brian P. Butz,et al.  An intelligent tutoring system for circuit analysis , 2006, IEEE Transactions on Education.

[14]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[15]  Yi-Hwa Liu,et al.  Software-Reconfigurable e-Learning Platform for Power Electronics Courses , 2008, IEEE Transactions on Industrial Electronics.

[16]  Jun Zhang,et al.  An Ant Colony Optimization Approach to a Grid Workflow Scheduling Problem With Various QoS Requirements , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[17]  Vincent P. Wade,et al.  Service-Oriented E-Learning Platforms: From Monolithic Systems to Flexible Services , 2007, IEEE Internet Computing.

[18]  Michael Sampels,et al.  Ant Algorithms for the University Course Timetabling Problem with Regard to the State-of-the-Art , 2003, EvoWorkshops.

[19]  Yung-Chin Yen,et al.  Design and evaluation of an XML-based platform-independent computerized adaptive testing system , 2005, IEEE Trans. Educ..

[20]  Thanassis Tiropanis,et al.  Grid-Based Virtual Laboratory Experiments for a Graduate Course on Sensor Networks , 2007, IEEE Transactions on Education.

[21]  S. Sitharama Iyengar,et al.  Biologically Inspired Cooperative Routing for Wireless Mobile Sensor Networks , 2007, IEEE Systems Journal.

[22]  Bertrand M. T. Lin,et al.  On the development of a computer-assisted testing system with genetic test sheet-generating approach , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[23]  Vladan Devedzic,et al.  Key issues in next-generation Web-based education , 2003, IEEE Trans. Syst. Man Cybern. Part C.

[24]  K.E. Holbert,et al.  Embedding remote experimentation in power engineering education , 2004, IEEE Transactions on Power Systems.

[25]  Gwo-Jen Hwang A tutoring strategy supporting system for distance learning on computer networks , 1998 .

[26]  Selwyn Piramuthu Knowledge-based web-enabled agents and intelligent tutoring systems , 2005, IEEE Transactions on Education.

[27]  Gwo-Jen Hwang On the development of a cooperative tutoring environment on computer networks , 2002, IEEE Trans. Syst. Man Cybern. Part C.

[28]  Jun Zhang,et al.  Pseudo Parallel Ant Colony Optimization for Continuous Functions , 2007, Third International Conference on Natural Computation (ICNC 2007).