International Journal of Information Technology and Computer Science (IJITCS)
IJITCS Vol. 6, No. 12, 8 Nov. 2014
Cover page and Table of Contents: PDF (size: 426KB)
Event-Coverage and Weight based Method for Test Suite Prioritization
Full Text (PDF, 426KB), PP.61-66
Views: 0 Downloads: 0
Author(s)
Neha Chaudhary
1,*
O.P. Sangwan
2
Richa Arora
3
Index Terms
Event coverage, GUI testing, Test-Suite Prioritization, Event-Coverage and Weight based Method (EC-WBM)
Abstract
There are many challenges in testing of Graphical User Interface (GUI) applications due to its event driven nature and infinite input domain. Testing each and every possible combination of input require creating number of test cases to satisfy the adequacy criteria of GUI testing. It is not possible to test each and every test case within specified time frame. Therefore it is important to assign higher priority to test cases which have higher fault revealing capability than other test cases. Various methods are specified in literature for test suite prioritization of GUI based software and some of them are based on interaction coverage and weight of events. Weight based methods are defined namely fault prone weight based method, random weight based method and equal weight based method in which fault prone based method is most effective. In this paper we have proposed Event-Coverage and Weight based Method (EC-WBM) which prioritizes GUI test cases according to their event coverage and weight value. Weight value will be assigned based on unique event coverage and fault revealing capability of events. Event coverage based method is used to evaluate the adequacy of test cases. EC-WBM is evaluated for 2 applications one is Notepad and another is Calculator. Fault seeding method is used to create number of versions of application and these faults are evaluated using APFD (Average percentage of fault detection). APFD for prioritized test cases of Notepad is 98% and APFD for non-prioritized test cases is 62%.
Cite This Paper
Neha Chaudhary, O.P. Sangwan, Richa Arora, "Event-Coverage and Weight based Method for Test Suite Prioritization", International Journal of Information Technology and Computer Science(IJITCS), vol.6, no.12, pp.61-66, 2014. DOI:10.5815/ijitcs.2014.12.08
Reference
[1]Memon Atif ,”Automatically Repairing Event Sequence-Based GUI Test Suites for Regression Testing,” ACM Transaction on Software Engineering and Method, Volume 18, Issue 2, 2008.
[2]Ishan Banerjee , Bao Nguyen, Vahid Garousi, Atif Memon, “ Graphical user interface (GUI) testing: Systematic mapping and repository”, in the Journal of Information and Software Technology, vol. 55, pp. 1679–1694, March 2013.
[3]Memon Atif, Soffa Lou Mary, Martha E. Pollack, “ Coverage Criteria for GUI Testing”, Proc.of the 8th European Software Engineering conference held jointly with 9th ACM SIGSOFT international symposium on Foundations of Software Engineering, pp. 256-267, 2001.
[4]Gerrard Paul, ”Testing GUI Applications”, EuroSTAR, Edinburgh UK, 1997.
[5]Bryce Renee C., Memon Atif ,” Test Suite Prioritization by Interaction Coverage”, Domain-Specific Approaches to Software Test Automation Workshop, Dubrovnik, Croatia, 2007.
[6]Huang Chin-Yu, Chang Jun-Ru and Chang Yung-Hsin, “Design and analysis of GUI test-case prioritization using weight-based methods,” in the Journal of Systems and Software vol. 83, pp. 646-659, 2010.
[7]Memon Atif, Lou Soffa Mary, E. Pollock Martha, “Coverage criteria for GUI testing,” in the proceeding of 21st International conference on software engineering, ACM press, pp 257-266, 1999.
[8]Izzat Alsmadi, Sascha Alda,“Test Cases Reduction and Selection Optimization in Testing Web Services,” published in the International Journal of Information Engineering and Electronic Business (IJIEEB), Vol.4, No.5, October 2012
[9]Chaudhary Neha, Sangwan O.P., Singh Yogesh, “Test Case Prioritization Using Fuzzy Logic for GUI based Software”, International Journal of Advanced Computer Science and Applications, 2012.
[10]Bryce Renee C., Sampath Sreedevi , Memon Atif, “Developing a single model and Test Prioritization Station for Event- Driven Software”, IEEE Transaction on Software Engineering, 2010.
[11]Xun Yuan, Myra B. Cohen. And Atif M. Memon, “GUI Interaction Testing: Incorporating Event Context” in IEEE Transactions on Software Engineering, vol. 37, no. 4, pp. 559-574, 2011.
[12]Bryce Renee C., Sampath Sreedevi, Pedersen Jan B., Manchester Schuyler, “Test suite prioritization by cost-based combinatorial interaction coverage”, Published in International Journal of System Assurance Engineering and Management vol 2, Issue 2, pp 126-134, 2011.
[13]Sebastian Elbaum, Gregg Rothermel, Satya Kanduri, and Alexey G. Malishevsky, “Selecting a Cost-Effective Test Case Prioritization Technique”, Software Quality Control 12, pp. 185-210, September 2004.
[14]Yuen Tak Yu and Man Fai Lau., “Fault-based test suite prioritization for specification-based testing”, Inf. Softw. Technol. 54, pp. 179-202, February 2012.
[15]Luay Tahat, Bogdan Korel, Mark Harman and Hasan Ural, “Regression test suite prioritization using system models”, Softw. Test. Verif. Reliab. 22, pp. 481-5067, November 2012.
[16]Sreedevi Sampath, Renee Bryce, and Atif Memon, “A Uniform Representation of Hybrid Criteria for Regression Testing”, IEEE Trans. Softw. Eng. 39, October 2013.
[17]Huang Chin-Yu, Peng Kuan-Li, and Huang Yu-Chi, “ A history-based cost-cognizant test case prioritization technique in regression testing,” Elsevier journal of The Journal of Systems and Software, 2011.
[18]Kaur and Kumari, HP QuickTest Professional version 11. 2010. HP – QTP version 11, Comparative study of Automated Testing Tools: Test Complete and QuickTest Pro, Punjab University, 2011.
[19]Rothermel G., Untch R.,H. Chu C., Harrold M. J., “Prioritizing test cases for regression testing”, IEEE Transactions on Software Engineering, vol. 27 (10), pp. 102-112, 2001.