International Journal of Modern Education and Computer Science (IJMECS)
ISSN: 2075-0161 (Print), ISSN: 2075-017X (Online)
Published By: MECS Press
IJMECS Vol.4, No.10, Oct. 2012
Comparing the Acceptance of Key Performance Indicators Management Systems on Perceived Usefulness and Perceived Ease of Use in a Higher Education Institution in Malaysia
Full Text (PDF, 624KB), PP.9-16
This article discusses the findings of a study that elucidated users’ acceptance of two management systems for key performance indicators (KPIs) in terms of their usefulness and ease of use scores at a higher education institution in Malaysia. The two management systems were Key Performance Indicators Monitoring System (KPI-MS) and Excel Spreadsheet System (ESS). ESS is a system developed using Microsoft Excel and has been in used since the year 2008 in the institution to calculate KPIs marks. The ESS system, however, has several shortcomings, and the KPI-MS system was developed with the intention to replace ESS. KPI-MS is an online KPI performance monitoring system which allows users to access the system wherever and whenever they want using a web browser. In addition, KPI-MS is designed as an intelligent system that is able to process raw data automatically to produce results that can be easily visualized in a graphical manner. A survey questionnaire was used to collect data on the acceptance of both systems. A total of 78 participants who were involved in KPI data processing from all 42 schools and centres in the higher education institution in Malaysia participated in this study. The instrument of this study was adapted and modified from Davis’ Technology Acceptance Model (TAM). This instrument was content-validated by three experts in the related field and the reliability index computed with Cronbach alpha was 0.955. A descriptive analysis was conducted to compare the mean scores of both KPI-MS and ESS rated by the users. The results showed that the users rated KPI-MS as a very useful system in monitoring KPI performance of their schools or centres compared to ESS. Also, users rated the KPI-MS to be significantly easier (p≤0.01) and more enjoyable to use. In conclusion, it is recommended that KPI-MS should replace the ESS system in managing KPIs data.
Cite This Paper
Mei Yean ONG,Balakrishnan Muniandy,Saw Lan ONG,Keow Ngang TANG,Kia Kien PHUA,"Comparing the Acceptance of Key Performance Indicators Management Systems on Perceived Usefulness and Perceived Ease of Use in a Higher Education Institution in Malaysia", IJMECS, vol.4, no.10, pp.9-16, 2012.
Xiong, G., Qin, T., Wang, F., Hu, L., & Shi, Q. (2010). Design and improvement of KPI system for materials management in Power Group Enterprise. IEEE, 171-176.
Arash, S., & Mahbod, M. A. (2007). Prioritization of key performance indicators: An integration of analytical hierarchy process and goal setting. [Article]. International Journal of Productivity & Performance Management, 56(3), 226-240.
Chan A. P. C., & L., C. A. P. (Apr 2004). Key performance indicators for measuring construction success. Benchmarking: An International Journal, 11(2), 203-216 (214 pages). doi: 10.1108/14635770410532624
Breakwell, G. M., & Tytherleigh, M. Y. (2010). University leaders and university performance in the United Kingdom: is it 'who' leads, or 'where' they lead that matter most? Science+Business Media 60, 491-506. doi: 10.1007/s10734-010-9311-0
Davis, F. D. (1986). A technology acceptance model for empirically testing new end-user information systems: theory and results. Doctorial Doctorial Dissertation, Massachusetts Institute of Technology.
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. Management Information Systems Research Center, University of Minnesota, 13(3), 319-340. doi: 10.2307/249008
Davis, F. D. (1993). User accceptance of information technology: system characteristics, user perceptions, and behavioural impacts. Int. J. Man-Machine Studies, 38, 475-487.
Ramayah, T., & Ignatius, J. (2005). Impact of perceived usefulness, perceived ease of use and perceived enjoyment on intention to shop online. ICFAI Journal of Systems Management (IJSM, III(3), 36 – 51.
Parka, N., Roman, R., Lee, S., & Chung, J. E. (2009). User acceptance of a digital library system in developing countries: An application of the Technology Acceptance Model. International Journal of Information Management, 29, 196–209.
Ong, M. Y., Muniandy, B., Ong, S. L., Tang, K. N., & Phua, K. K. (2011). User acceptance of a key performance indicators monitoring system (KPI-MS) in a higher education institution in Malaysia: A pilot study. Paper presented at the 5th International Malaysian Educational Technology Convention, Kuantan, Pahang, Malaysia.
Muniandy, B., Ong, M. Y., Phua, K. K., & Ong, S. L. (2011a). Assessing Key Performance Indicators Monitoring System (KPI-MS) of a university using Technology Acceptance Model. International Journal of Social Science and Humanity, 1(3), 171-176.
Muniandy, B., Ong, M. Y., Phua, K. K., & Ong, S. L. (2011b). User Acceptance of a Key Performance Indicators Monitoring System (KPI-MS) in Higher Education: An Application of the Technology Acceptance Model. Paper presented at the 2nd International Conference on Education and Management Technology, Shanghai, China.