International Journal of Modern Education and Computer Science (IJMECS)
IJMECS Vol. 13, No. 6, 8 Dec. 2021
Cover page and Table of Contents: PDF (size: 1176KB)
CIPP-SAW Application as an Evaluation Tool of E-Learning Effectiveness
Full Text (PDF, 1176KB), PP.42-59
Views: 0 Downloads: 0
Author(s)
Dewa Gede Hendra Divayana
1,*
I Putu Wisna Ariawan
1
Made Kurnia Widiastuti Giri
1
Index Terms
Application, CIPP, SAW, Evaluation, E-Learning
Abstract
The effectiveness level of e-learning implementation in the learning process at health colleges is very important for all users to know. Things that can be done to measure the level of effectiveness accurately is to carry out evaluation activities using computerized tools. One of the innovations found in this research was a computer-based evaluation application called the CIPP-SAW application. This application is formed by combining an educational evaluation model called CIPP (Context-Input-Process-Product) with a decision support system method called SAW (Simple Additive Weighting). Based on those situations, this research aimed to provide an overview of the user interface design and workings of the CIPP-SAW application used in evaluating the effectiveness of e-learning implemented in health colleges (case study in Bali province). This research was a development study using Borg & Gall’s design, which focused on the preliminary field test and main product revision stages. The subjects involved in the field trial of the CIPP-SAW application were 64 respondents. The respondents included: two informatics experts, two educational evaluation experts, 30 students, and 30 lecturers from several health colleges in Bali province. Data collection tools in the form of questionnaires, interview guidelines, and photo documentation. The analysis technique used was descriptive quantitative which compares the effectiveness level of the CIPP-SAW application with the effectiveness standard which refers to a scale of five. The results showed that the effectiveness level of the CIPP-SAW application was 87.521%, so it was in a good category.
Cite This Paper
Dewa Gede Hendra Divayana, I Putu Wisna Ariawan, Made Kurnia Widiastuti Giri, " CIPP-SAW Application as an Evaluation Tool of E-Learning Effectiveness", International Journal of Modern Education and Computer Science(IJMECS), Vol.13, No.6, pp. 42-59, 2021.DOI: 10.5815/ijmecs.2021.06.05
Reference
[1] D. O’Doherty, M. Dromey, J. Lougheed, A. Hannigan, J. Last, and D. McGrath, “Barriers and Solutions to Online Learning in Medical Education – An Integrative Review,” BMC Medical Education, Vol. 18, No. 130, pp. 1–11, 2018.
[2] I. K. Darma, “The Effectiveness of Teaching Program of CIPP Evaluation Model: Department of Mechanical Engineering, Politeknik Negeri Bali,” International Research Journal of Engineering, IT & Scientific Research, Vol. 5, No. 3, pp. 1–13, 2019.
[3] N.Q. Agustina, and F. Mukhtaruddin, “The CIPP Model-Based Evaluation on Integrated English Learning (IEL) Program at Language Center,” English Language Teaching Educational Journal (ELTEJ), Vol. 2, No. 1, pp. 22–31, 2019.
[4] Alexsandra, Ganefri, and Usmeldi, “Evaluation of Vocational School Pratic Program CIPP Model,” Journal of Educational Research and Evaluation, Vol. 2, No. 3, pp. 180–184, 2019.
[5] K. A. Umam, and I. Saripah, “Using the Context, Input, Process and Product (CIPP) Model in the Evaluation of Training Programs,” International Journal of Pedagogy and Teacher Education (IJPTE), Vol. 2, pp. 183–193, 2018.
[6] K. A. Umam, and I. Saripah,“The Evaluation of the CIPP Model in The Implementation of Character Education at Junior High School,” Innovative Journal of Curriculum and Educational Technology, Vol. 7, No. 2, pp. 65–77, 2018.
[7] H.M. Al-Shanawani, “Evaluation of Self-Learning Curriculum for Kindergarten Using Stufflebeam’s CIPP Model,” Sage Open, pp. 1–13, 2018.
[8] A. Maksum, M.R. Luddin, and F. Idris, “Evaluation Program for the Career Development of Indonesian Navy Civilian Personnel using the CIPP Evaluation Model and Analytical Hierarchy Process (AHP),” International Journal of Recent Technology and Engineering (IJRTE), Vol. 8, No. 4, pp. 1309–1316, 2019.
[9] Z. Kafi, K. Motallebzadeh, H. Khodabakhshzadeh, and M. Zeraatpisheh, “Developing, Glocalizing& Validating a Quality Indices Rubric in English Language Teaching: A Case of CIPP Model,” Cogent Education, Vol. 6, pp. 1–23, 2019.
[10] R.D. Leeuw, A.D. Soet, S.V.D. Horst, K. Walsh, M. Westerman, and F. Scheele, “How We Evaluate Postgraduate Medical E-Learning: Systematic Review,” JMIR Medical Education, Vol. 5, No. 1, pp. 1–15, 2019.
[11] I.N. Gunung, and I.K. Darma, “Implementing the Context, Input, Process, Product (CIPP) Evaluation Model to Measure the Effectiveness of the Implementation of Teaching at Politeknik Negeri Bali (PNB),” International Journal of Environmental & Science Education, Vol. 14, No. 1, pp. 33–39, 2019.
[12] I.M.A. Wirawan, and I.G.M. Darmawiguna, “New Concept of Learning Outcomes Assessment in Adaptive Mobile Learning,” Advances in Social Science, Education and Humanities Research, Vol. 134, pp. 263–268, 2017.
[13] B. Daniawan, “Evaluation of Lecturer Teaching Performance Using AHP and SAW Methods,” Bit-Tech, Vol. 1, No.2, pp. 30–39, 2018.
[14] N. Aminudin, M. Huda, A. Kilani, W.H.W. Embong, A.M. Mohamed, B. Basiron, S.S. Ihwani, S.S.M. Noor, K.A. Jasmi, J. Safar, N.L. Ivanova, A. Maseleno, A. Triono, and Nungsiati, “Higher Education Selection using Simple Additive Weighting,” International Journal of Engineering & Technology, Vol. 7, No.2, pp. 211–217, 2018.
[15] I.N. Jampel, I.W. Lasmawan, I.M. Ardana, I.P.W. Ariawan, I.M. Sugiarta, and D.G.H. Divayana, “Evaluation of Learning Programs and Computer Certification at Course Institute in Bali Using CSE-UCLA Based on SAW Simulation Model,” Journal of Theoretical and Applied Information Technology, Vol. 95, No. 24, pp. 6934–6949, 2017.
[16] A.H.M. Ragab, A.Y. Noaman, A.I. Madbouly, A.M. Khedra, and A.G. Fayoumi, “ESSAM: An assessment model for evaluating students satisfaction in e-learning environments,” International E-Journal of Advances in Education, Vol. 4, No. 11, pp. 168–177, 2018.
[17] S. Barteit, D. Guzek, A. Jahn, T. Bärnighausen, M.M. Jorge, and F. Neuhann, “Evaluation of e-learning for medical education in low- and middle-income countries: A systematic review,” Computers & Education, Vol. 145, pp. 1–18, 2020.
[18] Z. Zhang, P. Ran, Y. Peng, R. Hu, and W. Yan, “Effectiveness of e-Learning in Public Health Education: A Pilot Study,” International Journal of Information and Education Technology, Vol. 5, No. 8, pp. 577–581, 2015.
[19] R. Abdillah, and I. Kurniawan, “Multi-Attribute Decision Making using Fuzzy Simple Additive Weighting in E-Learning Institutions Selection,” 2017 International Conference on Education and Science, pp. 229–235, 2017.
[20] D.G.H. Divayana, I.P.W. Ariawan, A. Adiarta, D.P. Parmiti, I.W.E. Mahendra, and N.N. Parmithi, “Development of ANEKA-Based Countenance Model Integrated with Tri Hita Karana-SAW in Evaluating Student’s Character and Quality of Computer Learning in Bali,” Journal of Engineering and Applied Sciences, Vol. 13, No.15, pp. 6303–6315, 2018.
[21] D.Y.H. Tanjung, and R. Adawiyah, “Optimizing Selection of Decision Support System with Fuzzy Simple Additive Weighting,” The 6th International Conference on Cyber and IT Service Management (CITSM 2018), Medan, Indonesia, August 7-9, pp. 1–4, 2018.
[22] B.C. Cuong, N.T. Lich, and D.T. Ha, “Combining Fuzzy Set–Simple Additive Weight and Comparing with Grey Relational Analysis for Student’s Competency Assessment in the Industrial 4.0,” 10th International Conference on Knowledge and Systems Engineering, Ho Chi Minh City, Vietnam, November 1-3, pp. 294–299, 2018.
[23] Irvanizam, “Multiple Attribute Decision Making with Simple Additive Weighting Approach for Selecting the Scholarship Recipients at Syiah Kuala University,” 2017 International Conference on Electrical Engineering and Informatics (ICELTICs 2017), Banda Aceh, Indonesia, October 18-20, pp. 245–250, 2017.
[24] J. Kittur, “Optimal Generation Evaluation using SAW, WP, AHP and PROMETHEE Multi-Criteria Decision Making Techniques,” 2015 IEEE International Conference on Technological Advancements in Power & Energy, Kerala, India, June 24-26, pp. 304–309, 2015.
[25] M. Ali, S.M.K. Hossain, and T. Ahmed, “Effectiveness of E-learning for University Students: Evidence from Bangladesh,” Asian Journal of Empirical Research, Vol. 8, No. 10, pp. 352–360, 2018.
[26] K. Hadullo, R. Oboko, and E. Omwenga, “A Model for Evaluating E-Learning Systems Quality in Higher Education in Developing Countries,” International Journal of Education and Development using Information and Communication Technology, Vol. 13, No. 2, pp. 185–204, 2017.
[27] M. Misut, and K. Pribilova, “Measuring of Quality in the Context of e-Learning,” Procedia - Social and Behavioral Sciences, Vol. 177, pp. 312–319, 2015.
[28] Q.N. Naveed, M.R.N. Qureshi, N. Tairan, A. Mohammad, A. Shaikh, A.O. Alsayed, A. Shah, and F.M. Alotaibi, “Evaluating Critical Success Factors in Implementing E-Learning System using Multi-Criteria Decision-Making,” PLoS ONE, Vol. 15, No. 5, pp. 312–319, 2020.