International Journal of Modern Education and Computer Science (IJMECS)
IJMECS Vol. 13, No. 5, 8 Oct. 2021
Cover page and Table of Contents: PDF (size: 540KB)
Implementation of Usability Testing Methods to Measure the Usability Aspect of Management Information System Mobile Application (Case Study Sukamiskin Correctional Institution)
Full Text (PDF, 540KB), PP.58-67
Views: 0 Downloads: 0
Author(s)
Index Terms
Usability, usability testing, usability evaluation, mobile application, e-government, performance measurement, retrospective think aloud
Abstract
The aim of this study is to measure the usability aspects of Management Information System mobile application in terms of effectiveness, efficiensy, and user satisfaction by using performance measurement techniques, usability questionnaires and retrospective think aloud. Management Information System application is an internal mobile application that has functions to exchange information, fill daily absences, apply for leave and fill in the daily work journal of the Ministry of Justice and Human Rights employees. Until today, the mobile application of Management Information System has not been evaluated yet using the level of usability. This research was conducted by measuring the level of effectiveness, efficiency, satisfaction and retrospective think aloud. Due to the limitations of this study, researcher only gain 20 respondents who were all employees of Sukamiskin Correctional Institution within questionnaire. In addition, respondents also filled out the questionnaire given. Based on the results obtained the effectiveness level reached 100% and all respondents expressed satisfaction with mobile application of Management Information System. But in terms of efficiency needs to be more improved. And the results of the retrospective think aloud are still some improvements from the features and reduction of icons that appear on the screen. The results showed that using performance measurements and retrospective think aloud techniques had a significant effect on user satisfaction in sukamiskin correctional institution. With this techniques also shows the level of employee ability to complete tasks in the application does not fail.
Cite This Paper
Hafidz. Firdaus, Azizah. Zakiah, " Implementation of Usability Testing Methods to Measure the Usability Aspect of Management Information System Mobile Application (Case Study Sukamiskin Correctional Institution)", International Journal of Modern Education and Computer Science(IJMECS), Vol.13, No.5, pp. 58-67, 2021.DOI: 10.5815/ijmecs.2021.05.06
Reference
[1] M. G. Arsawiguna, A. A. K. Agung, C. Wiranatha, dan K. S. Wibawa, “Rancang Bangun Aplikasi Game Tajen Berbasis Android menggunakan Artificial Intelligence”, Lontar Komputer, vol. 6, no. 2, hal. 84-95, 2015.
[2] I. P. P. Andika, P. A. Bayupati, dan N. K. A. Wirdani, “Rancang Bangun Aplikasi Pendeteksi Tipe dan Nilai Resistor Berbasis Android”, Lontar Komputer, vol. 6, no. 1, hal. 529-540, 2015.
[3] Dae-Ho Byun, “Evaluating usability, user satisfaction and intention to revisit for successful e-government websites”, 2011.
[4] Nielsen, J. (2000). Why you Only Need to Test with 5 Users. Jakob Nielsens Alertbox, 19(September 23), 1-4.
[5] Lazar, J., Feng, J. H. & Hochheiser, H. “Research Methods in Human-Computer Interaction 2nd edition”, Morgan Kaufmann, Cambridge (2017).
[6] R. Baharuddin, D. Singh, D and R. Razali, R, Usability Dimensions for Mobile Applications-A Review. Research Journal of Applied Sciences, Engineering and Technology, 5(6), 2013, pp. 2225-2231.
[7] H. Hoehle and V. Venkatesh, V, Mobile Application Usability: Conceptualization and Instrument Development. MIS Quarterly, 39(2), 2015, pp. 435-472.
[8] H. M. Az-zahra, A. Pinandito, and H. Tolle, Usability Evaluation of Mobile Application in Culinary Recommendation System. 2015.
[9] S. Utama, Perbaikan User Interface Halaman Internet Banking dengan Metode Usability Testing. 2011.
[10] S. R. Wardhana, D. Purwitasari, dan S. Rochimah, Analisis Sentimen pada Review Pengguna Aplikasi Mobile untuk Evaluasi Faktor Usability. 2016.
[11] H. Hoehle dan V. Venkatesh, Mobile Application Usability: Conceptualization and Instrument Development, 2015.
[12] D. H. Syaifullah, M. A. Puspasari, dan A. Hanifah, Analisis User Experience pada Penggunaan Aplikasi Mobile Jakarta Smart City. 2017.
[13] M. D. Fahmi, H. M. Az-zahra, dan R. K. Dewi, Perbaikan Usability Aplikasi Pemesanan Tiket Bioskop Menggunakan Metode Usability Testing dan USE Questionnaire. 2018.
[14] Tullis, Tom, and Albert, Bill. 2008. Measuring The User Experience. Morgan Kauffman.
[15] A. Fernandez, E. Insfran, and S. Abrahao, “Usability evaluation methods for the web: A Systematic mapping study,” Inf. Softw. Technol., vol. 53, pp. 789-817, 2011.
[16] F. Paz and J. A. Pow-Sang, “A systematic mapping review of usability evaluation methods for software development process,” Int. J. Sotw. Eng. Its Appl., vol. 10, no. 1, pp. 165-178, 2016.
[17] M. G. Zaragoza, H. Kim, and D. S. Han, “Mobile Application Development, Approaches, Advancement and Process,” vol. 10, no. 10, pp. 79-88, 2016.
[18] K. Wac, S. Ickin, J.-H. Hong, L. Janowski, M. Fiedler, and A. K. Dey, “Studying the Experience of Mobile Applications Used in Different Context of Daily Life Categories and Subject Descriptors,” Proc. first ACM SIGCOMM Work. Meas. Up stack, pp. 7-12, 2011.
[19] Singun, A. P. Usability Metrics for a Web-Based Test Blueprint System. Journal of Engineering and Applied Sciences, 12: 6898-6903. Medwell Journals, Faisalabad (2017).
[20] Betram, D.: Likert Scale. 2016
[21] Jorgensen, S., & Marthandan, G. (2010). Thinking-aloud in user interface design: a method promoting cognitive ergonomics. Ergonomics, vol. 33, no. 4, pp. 501-507.
[22] E. Geisenand J.R. Bergstrom, Usability Testing for Survey Research. Chennai: Elsevier. 2017.
[23] C.M. Barnum, N. Bevan, G. Cockton, J. Nielsen, J. Spool, and D. Wixon, The “Magic Number 5”: Is It Enough for Web Testing?. CHI ’03 Extended Abstracts on Human Factors in Computing Systems, Ft. Lauderdale, California: ACM. 2003, pp. 698-699.
[24] J. Nielsen, Usability Engineering. Mountain View, California: Morgan Kaufmann. 1993.
[25] N. L. P. A. Wedayanti, N. K. A. Wirdiani, I. K. A. Purnawan, Evaluasi Aspek Usability pada Aplikasi Simalu Menggunakan Metode Usability Testing. 2019.
[26] J. Rubin and D. Chisnell, Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests 2nd edition. Indianapolis, Indiana: Wiley Publishing, Inc. 2008.
[27] Fung, R. H. Y.*, Chiu, D. K. W., Ko, E. H. T.*, Ho, K. K., & Lo, P. (2016). Heuristic Usability Evaluation of University of Hong Kong Libraries’ Mobile Website. The Journal of Academic Librarianship, in press.
[28] T. Tullis, and W. Albert, Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics (Interactive Technologies), 2nd edition. Massachusetts: Elsevier. 2013.
[29] R. Harrison, D. Flood, and D. Duce, Usability of mobile applications: literature review and rationale for a new usability model. Journal of Interaction Science, 1(1), 2013, pp. 1-16.
[30] T. Neil, Mobile Design Pattern Gallery: UI Patterns for Smartphone Apps. Sebastopol: O’Reily Media. 2014.
[31] M. Hassenzahl, and N. Tractinsky, User Experience: a research agenda. Behaviour and Information Technology, 25(2), 2006, pp. 91-97.
[32] A. W. Kushniruk, M. M. Triola, E. M. Boryckic, B. Steind, and J. L. Kannrye, Technology induced error and usability: The relationship between usability problems and prescription errors when using a handheld application. International Journal of Medical Informatics, 74(1), 2005, pp. 519-526.