International Journal of Intelligent Systems and Applications (IJISA)
IJISA Vol. 4, No. 7, 8 Jun. 2012
Cover page and Table of Contents: PDF (size: 1206KB)
A Comparison of BA, GA, PSO, BP and LM for Training Feed forward Neural Networks in e-Learning Context
Full Text (PDF, 1206KB), PP.23-29
Views: 0 Downloads: 0
Author(s)
Koffka Khan
1,*
Ashok Sahai
2
Index Terms
Neural networks, supervised learning, metaheuristic, bat algorithm, backpropagation, Levenberg-Marquardt, genetic algorithm, particle swarm optimization
Abstract
Training neural networks is a complex task of great importance in the supervised learning field of research. We intend to show the superiority (time performance and quality of solution) of the new metaheuristic bat algorithm (BA) over other more “standard” algorithms in neural network training. In this work we tackle this problem with five algorithms, and try to over a set of results that could hopefully foster future comparisons by using a standard dataset (Proben1: selected benchmark composed of problems arising in the field of Medicine) and presentation of the results. We have selected two gradient descent algorithms: Back propagation and Levenberg-Marquardt, and three population based heuristic: Bat Algorithm, Genetic Algorithm, and Particle Swarm Optimization. Our conclusions clearly establish the advantages of the new metaheuristic bat algorithm over the other algorithms in the context of eLearning.
Cite This Paper
Koffka Khan, Ashok Sahai, "A Comparison of BA, GA, PSO, BP and LM for Training Feed forward Neural Networks in e-Learning Context", International Journal of Intelligent Systems and Applications(IJISA), vol.4, no.7, pp.23-29, 2012. DOI:10.5815/ijisa.2012.07.03
Reference
[1]Alavi, M., Yoo, Y., &Vogel. D. R. Using Information Technology to Add Value to Management Education. The Academy of Management Journal, 40: 1310-1333, 1997.
[2]Ardito, C. et al. An approach to usability evaluation of eLearning applications. Universal Access in the Information Society, 4(3): 270-283, 2005.
[3]Boehner, K., DePaula, R., Dourish, P. & Sengers, P. How emotion is made and measured. Int. Journal of Human-Computer Studies, 65: 275-291, 2007.
[4]Branco, P., Firth, P., Encarnacao, M., & Bonato, P. Faces of Emotion in Human-Computer Interaction. CHI 2005, 2005.
[5]Chiu, C., Hsu, M., Sun, S., Lin, T., Sun, P. Usability, quality, value and eLearning continuance decisions. Computers & Education, 45: 4, 2005.
[6]Council of Ministers of Education. UNESCO World Conference on Higher Education, Report, 1998.
[7]Hannula, M. Motivation in mathematics: Goals reflected in emotions. Educational Studies in Mathematics, 63(2), 2006.
[8]ISO 9241. Software Ergonomics Requirements for office work with visual display terminal (VDT). Part 11: Guidance on usability, International Organisation for Standardisation, 1998.
[9]Juutinen, S. & Saariluoma, P. Usability and emotional obstacles in adopting eLearning - A case study. Proc. IRMA International conference, 2007.
[10]Juutinen, S., Saariluoma, P., Iaitos, T. Emotional obstacles for eLearning - a user psychological analysis. European Journal of Open, Distance and ELearning, 2008.
[11]Keevil, B. Measuring the usability index of your website. Computer and Information Science, 271-277, 1998.
[12]Koohang, A. Foundations of Informing Science. T. Grandon Gill & Eli Cohen (eds.), (5): 113-134, 2008.
[13]Kumar, A., Kumar, P. & Basu, S.C. Student perceptions of virtual education: An exploratory study. Proc. Information Resources Management Association International Conference, 400–403, 2001.
[14]Likert, R. A technique for the measurement of attitudes. Archives of psychology, 22(140), 1932.
[15]Nebro, A., Durillo, J., Coello, C., Luna, F., Alba, E. A Study of Convergence Speed in Multi-objective Metaheuristics. Parallel problem solving from nature, Springer, Lecture Notes in Computer Science, 5199: 763-772, 2008.
[16]Paneva, D., Zhelev, Y. Models, Techniques and Applications of eLearning Personalization. International Journal. ITK, 1(3): 244-250, 2007.
[17]Parrott, W. G. (). The nature of emotion. Emotions and motivation. In M. Brewer and M. Hewstone (Eds.), 2004.
[18]Prechelt, L. Proben1 | A Set of Neural Network Benchmark Problems and Benchmarking Rules. Technical Report. Fakultat fur Informatik, Universitat Karlsruhe, 76128 Karlsruhe, Germany.
[19]Ruiz, G.J., Mintzer, J.M., Leipzig, M.R. The Impact of ELearning on Medical Education. ELearning and Digital Media, 8(1): 31-35, 2011.
[20]Shneiderman, B. Exploratory experiments in programmer behavior. International Journal of Computer and Information Sciences, 5: 123-143, 1976.
[21]Trentin, G. Using a wiki to evaluate individual contribution to a collaborative learning project. Journal of computer assisted learning, 25(1): 43-55, 2009.
[22]Villiers, R.D. Usability evaluation of an eLearning tutorial: criteria, questions and case study. Proc. IT research in developing countries, ACM, 75: 284-291.
[23]Xin-She Yang. A New Metaheuristic Bat-Inspired Algorithm. Nature Inspired Cooperative Strategies for Optimization (NICSO). Studies in Computational Intelligence, 284:65-74, 2010.