International Journal of Modern Education and Computer Science (IJMECS)
IJMECS Vol. 16, No. 3, 8 Jun. 2024
Cover page and Table of Contents: PDF (size: 1149KB)
Automatic Real-Time Adaptation of Training Session Difficulty Using Rules and Reinforcement Learning in the AI-VT ITS
PDF (1149KB), PP.56-71
Views: 0 Downloads: 0
Author(s)
Daniel Soto Forero
1,*
Simha Ackermann
1
Marie Laure Betbeder
1
Julien Henriet
1
Index Terms
Real Time Adaptation, Intelligent Training System, Thompson Sampling, Case-Based Reasoning, Automatic Adaptation
Abstract
Some of the most common and typical issues in the field of intelligent tutoring systems (ITS) are (i) the correct identification of learners’ difficulties in the learning process, (ii) the adaptation of content or presentation of the system according to the difficulties encountered, and (iii) the ability to adapt without initial data (cold-start). In some cases, the system tolerates modifications after the realization and assessment of competences. Other systems require complicated real-time adaptation since only a limited number of data can be captured. In that case, it must be analyzed properly and with a certain precision in order to obtain the appropriate adaptations. Generally, for the adaptation step, the ITS gathers common learners together and adapts their training similarly. Another type of adaptation is more personalized, but requires acquired or estimated information about each learner (previous grades, probability of success, etc.). Some of these parameters may be difficult to obtain, and others are imprecise and can lead to misleading adaptations. The adaptation using machine learning requires prior training with a lot of data. This article presents a model for the real time automatic adaptation of a predetermined session inside an ITS called AI-VT. This adaptation process is part of a case-based reasoning global model. The characteristics of the model proposed in this paper (i) require a limited number of data in order to generate a personalized adaptation, (ii) do not require training, (iii) are based on the correlation to complexity levels, and (iv) are able to adapt even at the cold-start stage. The proposed model is presented with two different configurations, deterministic and stochastic. The model has been tested with a database of 1000 learners, corresponding to different knowledge levels in three different scenarios. The results show the dynamic adaptation of the proposed model in both versions, with the adaptations obtained helping the system to evolve more rapidly and identify learner weaknesses in the different levels of complexity as well as the generation of pertinent recommendations in specific cases for each learner capacity.
Cite This Paper
Daniel Soto Forero, Simha Ackermann, Marie Laure Betbeder, Julien Henriet, "Automatic Real-Time Adaptation of Training Session Difficulty Using Rules and Reinforcement Learning in the AI-VT ITS", International Journal of Modern Education and Computer Science(IJMECS), Vol.16, No.3, pp. 56-71, 2024. DOI:10.5815/ijmecs.2024.03.05
Reference
[1]Nkambou, R., Bourdeau, J. & Mizoguchi, R. Advances in Intelligent Tutoring Systems. (Springer Berlin, Heidel- berg,2010)
[2]Tapalova, O. & Zhiyenbayeva, N. Artificial Intelligence in Education: AIEd for Personalised Learning Pathways. Electronic Journal Of E-Learning. pp. 15 (2022), https://eric.ed.gov/?q=Artificial+Intelligence+in+Education
[3]Roldan Reyes, E., Negny, S., Cortes Robles, G. & Le Lann, J. Improvement of online adaptation knowledge acqui- sition and reuse in case-based reasoning: Application to process engineering design. Engineering Applications Of Artificial Intelligence. 41 pp. 1-16 (2015), https://www.sciencedirect.com/science/article/pii/S0952197615000263
[4]Lepage, Y., Lieber, J., Mornard, I., Nauer, E., Romary, J. & Sies, R. The French Correction: When Retrieval Is Harder to Specify than Adaptation. Case-Based Reasoning Research And Development. pp. 309-324 (2020)
[5]Richter, M. & Weber, R. Case-Based Reasoning (A Textbook). (Springer-Verlag GmbH,2013)
[6]Bahramian, Z., Ali Abbaspour, R. & Claramunt, C. A Cold Start Context-Aware Recommender System for Tour Planning Using Artificial Neural Network and Case Based Reasoning. (2017), https://doi.org/10.1155/2017/9364903
[7]Muangprathub, J., Boonjing, V. & Chamnongthai, K. Learning recommendation with formal concept analysis for intelligent tutoring system. Heliyon. 6, e05227 (2020), https://www.sciencedirect.com/science/article/pii/S2405844020320703
[8]Lin, B. Evolutionary Multi-Armed Bandits with Genetic Thompson Sampling. 2022 IEEE Congress On Evolution- ary Computation (CEC). pp. 1-8 (2022)
[9]Henriet, J., Christophe, L. & Laurent, P. Artificial Intelligence-Virtual Trainer: An educative system based on artificial intelligence and designed to produce varied and consistent training lessons. Proceedings Of The Insti- tution Of Mechanical Engineers, Part P: Journal Of Sports Engineering And Technology. 231, 110-124 (2017), https://doi.org/10.1177/1754337116651013
[10]Henriet, J. & Greffier, F. AI-VT: An Example of CBR that Generates a Variety of Solutions to the Same Problem. Case-Based Reasoning Research And Development. pp. 124-139 (2018)
[11]Huang, A., Lu, O. & Yang, S. Effects of artificial Intelligence–Enabled personalized recommendations on learners’ learning engagement, motivation, and outcomes in a flipped classroom. Computers And Education. 194 pp. 104684 (2023), https://www.sciencedirect.com/science/article/pii/S036013152200255X
[12]Ingkavara, T., Panjaburee, P., Srisawasdi, N. & Sajjapanroj, S. The use of a personalized learning approach to implementing self-regulated online learning. Computers And Education: Artificial Intelligence. 3 pp. 100086 (2022), https://www.sciencedirect.com/science/article/pii/S2666920X22000418
[13]Lalitha, T. & Sreeja, P. Personalised Self-Directed Learning Recommendation System. Procedia Computer Sci- ence. 171 pp. 583-592 (2020), https://www.sciencedirect.com/science/article/pii/S1877050920310309, Third Inter- national Conference on Computing and Network Communications (CoCoNet’19)
[14]Zhao, L., Wang, D., Liang, F. & Chen, J. A recommendation system for effective learning strategies: An in- tegrated approach using context-dependent DEA. Expert Systems With Applications. 211 pp. 118535 (2023), https://www.sciencedirect.com/science/article/pii/S0957417422016104
[15]Zhou, L. & Wang, C. Research on Recommendation of Personalized Exercises in English Learning Based on Data Mining. Scientific Programming. 2021 pp. 5042286 (2021,12), https://doi.org/10.1155/2021/5042286
[16]Ezaldeen, H., Misra, R., Bisoy, S., Alatrash, R. & Priyadarshini, R. A hybrid E-learning recommenda- tion integrating adaptive profiling and sentiment analysis. Journal Of Web Semantics. 72 pp. 100700 (2022), https://www.sciencedirect.com/science/article/pii/S1570826821000664
[17]Gomede, E., De Barros, R. & Souza Mendes, L. Deep auto encoders to adaptive E-learning recommender system. Computers And Education: Artificial Intelligence. 2 pp. 100009 (2021), https://www.sciencedirect.com/science/article/pii/S2666920X21000035
[18]Chiu, T., Xia, Q., Zhou, X., Chai, C. & Cheng, M. Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Computers And Education: Artificial Intelli- gence. 4 pp. 100118 (2023), https://www.sciencedirect.com/science/article/pii/S2666920X2200073X
[19]Smyth, B. & Cunningham, P. An Analysis of Case Representations for Marathon Race Prediction and Planning. Case-Based Reasoning Research And Development. pp. 369-384 (2018)
[20]Smyth, B. & Willemsen, M. Predicting the Personal-Best Times of Speed Skaters Using Case-Based Reasoning. Case-Based Reasoning Research And Development. pp. 112-126 (2020)
[21]Supic,H.Case-BasedReasoningModelforPersonalizedLearningPathRecommendationinExample-BasedLearn- ing Activities. 2018 IEEE 27th International Conference On Enabling Technologies: Infrastructure For Collabora- tive Enterprises (WETICE). pp. 175-178 (2018)
[22]Eide, S., Leslie, D. & Frigessi, A. Dynamic slate recommendation with gated recurrent units and Thompson sam- pling. (2022), https://doi.org/10.1007/s10618-022-00849-w
[23]Brode ́n, B., Hammar, M., Nilsson, B. & Paraschakis, D. Ensemble Recommendations via Thompson Sampling: An Experimental Study within e-Commerce. 23rd International Conference On Intelligent User Interfaces. pp. 19-29 (2018), https://doi.org/10.1145/3172944.3172967
[24]Akerblom, N., Hoseini, F. & Haghir Chehreghani, M. Online learning of network bottlenecks via minimax paths. (2023), https://doi.org/10.1007/s10994-022-06270-0
[25]Mao, K., Dong, Q., Wang, Y. & Honga, D. An Exploratory Approach to Intelligent Quiz Question Recommendation. Procedia Computer Science. 207 pp. 4065-4074 (2022), https://www.sciencedirect.com/science/article/pii/S1877050922013631, Knowledge-Based and Intelligent In- formation Engineering Systems: Proceedings of the 26th International Conference KES2022
[26]Arthurs, N., Stenhaug, B., Karayev, S. & Piech, C. Grades Are Not Normal: Improving Exam Score Models Using the Logit-Normal Distribution. International Conference On Educational Data Mining (EDM). pp. 6 (2019), https://eric.ed.gov/?id=ED599204
[27]Zhang., K. & Aslan, A. AI technologies for education: Recent research and future directions. Computers and Education: Artificial Intelligence. 2 pp. 100025 (2021), https://www.sciencedirect.com/science/article/pii/S2666920X21000199
[28]James, S., Harbron, C., Branson, J. et al. Synthetic data use: exploring use cases to optimise data utility. Discov Artif Intell 1, 15 (2021). https://doi.org/10.1007/s44163-021-00016-y