International Journal of Modern Education and Computer Science (IJMECS)
IJMECS Vol. 7, No. 2, 8 Feb. 2015
Cover page and Table of Contents: PDF (size: 580KB)
An Efficient Algorithm for Finding a Fuzzy Rough Set Reduct Using an Improved Harmony Search
Full Text (PDF, 580KB), PP.16-23
Views: 0 Downloads: 0
Author(s)
Essam Al Daoud
1,*
Index Terms
Discernibility matrix, Feature selection, Fuzzy rough set, Harmony search, Optimization
Abstract
To increase learning accuracy, it is important to remove misleading, redundant, and irrelevant features. Fuzzy rough set offers formal mathematical tools to reduce the number of attributes and determine the minimal subset. Unfortunately, using the formal approach is time consuming, particularly if a large dataset is used. In this paper, an efficient algorithm for finding a reduct is introduced. Several techniques are proposed and combined with the harmony search, such as using a balanced fitness function, fusing the classical ranking methods with the fuzzy-rough method, and applying binary operations to speed up implementation. Comprehensive experiments on 18 datasets demonstrate the efficiency of using the suggested algorithm and show that the new algorithm outperforms several well-known algorithms.
Cite This Paper
Essam Al Daoud, "An Efficient Algorithm for Finding a Fuzzy Rough Set Reduct Using an Improved Harmony Search", International Journal of Modern Education and Computer Science (IJMECS), vol.7, no.2, pp.16-23, 2015. DOI:10.5815/ijmecs.2015.02.03
Reference
[1]S.Y. Zhao, E.C. Tsang and D.G. Chen, "The model of fuzzy variable precision rough sets," IEEE Trans. Fuzzy Syst., vol. 17, no. 2, 2009, pp 451–467.
[2]S.Y. Zhao, E.C. Tsang, D.G. Chen and X. Z. Wang, "Building a rule-based classifier—A fuzzy-rough set approach," IEEE Trans. Knowl. Data Eng., vol. 22, no. 5, 2010, pp. 624–638.
[3]K. G. Saharidis, G. Kolomvos, and G. Liberopoulos, "Modeling and Solution Approach for the Environmental Traveling Salesman Problem," Engineering Letters, vol. 22, no. 2, 2014, pp. 70-74.
[4]A. Soleimani, and Z. Kobti, "Toward a Fuzzy Approach for Emotion Generation Dynamics Based on OCC Emotion Model," IAENG International Journal of Computer Science, vol. 41, no. 1, 2014, pp. 48-61.
[5]H.H. Huang, and Y. H. Kuo, "Cross-lingual document representation and semantic similarity measure: A fuzzy set and rough set based approach," IEEE Trans. Fuzzy Syst., vol. 18, no. 6, 2010, pp. 1098–1111.
[6]T.J. Li, and W.X. Zhang, "Rough fuzzy approximations on two universes of discourse," Inform. Sci., vol. 178, pp. 892–906, 2008.
[7]Q. Hu, S. An, X. Yu, and D. Yu, "Robust fuzzy rough classifiers," Fuzzy Sets Syst., vol. 183, 2011, pp. 26–43.
[8]D. Chen, L. Zhang, S. Zhao, Q. Hu, and P. Zhu, "A Novel Algorithm for Finding Reducts With Fuzzy Rough Sets ," IEEE Trans. Fuzzy Syst., vol. 20, no. 2, 2012, pp. 385-389.
[9]J. Zhang, J. Wang, D. Li, H. He, and J. Sun, "A New Heuristic Reduct Algorithm Base on Rough Sets Theory," In Proceedings of The 4th International Conference of WAIM, Springer Berlin / Heidelberg, Advances in Web-Age Information Management, LNCS, vol. 2762, 2003, pp. 247-253.
[10]R. Jensen and Q. Shen, "Finding rough set reducts with ant colony optimization," In Proceeding of 2003 UK Workshop Computational Intelligence, 2004, pp.15-22.
[11]X. Wang, J. Yang, X. Teng, W. Xia and R. Jensen, "Feature selection based on Rough Sets and Particle Swarm Optimization," Pattern Recognition Letters, vol. 28, no. 4, 2007, pp. 459–471.
[12]R. Diao and Q. Shen, "Two New Approaches to Feature Selection with Harmony Search," WCCI 2010 IEEE World Congress on Computational Intelligence, 2010, pp. 18-23.
[13]E.C. Tsang, D. G. Chen, D. S. Yeung, X. Z. Wang, and J. T. Lee, "Attributes reduction using fuzzy rough sets," IEEE Trans. Fuzzy Syst., vol. 16, no. 5, 2008, pp.1130–1141.
[14]J. Liu, Q. Hu, and D. Yu, "A weighted rough set based method developed for class imbalance learning," Information Sciences, vol. 178, 2008, pp. 1235–1256.
[15]D. Chen, Q. Hu and Y. Yang, "Parameterized attribute reduction with Gaussian kernel based fuzzy rough sets," Information Sciences, vol. 181, 2011, pp. 5169–5179.
[16]Y. V. Bodyanskiy, O. K. Tyshchenko and D. S. Kopaliani, "A Multidimensional Cascade Neuro-Fuzzy System with Neuron Pool Optimization in Each Cascade," International Journal of Information Technology and Computer Science, vol 6, no 8, 2014, pp 11-17. DOI: 10.5815/ijitcs.2014.08.02.
[17]M. Barman and J. P. Chaudhury, "A Framework for Selection of Membership Function Using Fuzzy Rule Base System for the Diagnosis of Heart Disease," International Journal of Information Technology and Computer Science, vol 5, no 11, 2013, pp 62-70. DOI: 10.5815/ijitcs.2013.11.07.
[18]Q. Hu, S. An and D. Yu, "Soft fuzzy rough sets for robust feature evaluation and selection," Information Sciences, vol. 180, 2010, pp. 4384–4400.
[19]Z. Pawlak, "Rough Sets," Int. J. Compute Inf. Sci., vol. 11, 1982, pp. 341–356.
[20]Z. Pawlak, Rough Sets: Theoretical Aspects of Reasoning about Data, Kluwer Academic Publishers. 1991.
[21]X.D. Liu, W. Pedrycz, T.Y. Chai, and M. L. Song, "The development of fuzzy rough sets with the use of structures and algebras of axiomatic fuzzy sets," IEEE Trans. Knowl. Data Eng., vol .21, no. 3, 2009, pp. 443–462.
[22]R. Jensen, and Q. Shen, "New approaches to fuzzy-rough feature selection," IEEE Trans. Fuzzy Syst., vol. 17, no. 4, 2009, pp. 824–838.
[23]Z.W. Geem, J. H. Kim, and G.V. Loganathan, "A new heuristic optimization algorithm: harmony search," Simulation, vol. 76, 2011, pp. 60–68.
[24]Z.W. Geem, "Music-Inspired Harmony Search Algorithm: Theory and Applications," Studies in Computational Intelligence, Springer, vol. 191, 2009, pp. 1-14.
[25]G. Georgoulas, P. Karvelis, G. Iacobellis, V. Boschian, M. P. Fanti, W. Ukovich, and C. D. Stylios, "Harmony Search augmented with Optimal Computing Budget Allocation Capabilities for Noisy Optimization," IAENG International Journal of Computer Science, vol 40, no.4, 2013, pp. 285-290.
[26]O. M. Alia and M. Rajeswari, "The variants of the harmony search algorithm: an Overview," Artif. Intell. Rev., vol. 36, 2011, pp. 49–68.
[27]M. Gabli, J. El Miloud, and M. El Bekkaye, " A Genetic Algorithm Approach for an Equitable Treatment of Objective Functions in Multi-objective Optimization Problems," IAENG International Journal of Computer Science, vol. 41, no. 2, 2014, pp. 102-111.
[28]K. Tamura, and H.Kitakami, "A New Distributed Modified Extremal Optimization using Tabu Search Mechanism for Reducing Crossovers in Reconciliation Graph and Its Performance Evaluation," IAENG International Journal of Computer Science, vol. 41, no. 2, 2014, pp. 131-140.
[29]UCI Machine Learning Repository. (2005). [Online]. http://www.ics.uci.edu/ mlearn /MLRepository.html.