An Ensemble of Adaptive Neuro-Fuzzy Kohonen Networks for Online Data Stream Fuzzy Clustering

Full Text (PDF, 484KB), PP.12-18

Views: 0 Downloads: 0

Author(s)

Zhengbing Hu 1,* Yevgeniy V. Bodyanskiy 2 Oleksii K. Tyshchenko 2 Olena O. Boiko 2

1. School of Educational Information Technology, Central China Normal University, Wuhan, China

2. Kharkiv National University of Radio Electronics, Kharkiv, Ukraine

* Corresponding author.

DOI: https://doi.org/10.5815/ijmecs.2016.05.02

Received: 12 Feb. 2016 / Revised: 5 Mar. 2016 / Accepted: 2 Apr. 2016 / Published: 8 May 2016

Index Terms

Computational Intelligence, Data Stream Processing, Neuro-Fuzzy System, Fuzzy Clustering, Machine Learning

Abstract

A new approach to data stream clustering with the help of an ensemble of adaptive neuro-fuzzy systems is proposed. The proposed ensemble is formed with adaptive neuro-fuzzy self-organizing Kohonen maps in a parallel processing mode. Their learning procedure is carried out with different parameters that define a nature of cluster borders’ blurriness. Clusters’ quality is estimated in an online mode with the help of a modified partition coefficient which is calculated in a recurrent form. A final result is chosen by the best neuro-fuzzy self-organizing Kohonen map.

Cite This Paper

Zhengbing Hu, Yevgeniy V. Bodyanskiy, Oleksii K. Tyshchenko, Olena O. Boiko, "An Ensemble of Adaptive Neuro-Fuzzy Kohonen Networks for Online Data Stream Fuzzy Clustering", International Journal of Modern Education and Computer Science(IJMECS), Vol.8, No.5, pp.12-18, 2016. DOI:10.5815/ijmecs.2016.05.02

Reference

[1]F. Hoeppner, F. Klawonn, R. Kruse, and T. Runkler, Fuzzy Clustering Analysis: Methods for Classification, Data Analysis and Image Recognition, Chichester: John Wiley & Sons, 1999.
[2]R. Xu and D.C. Wunsch, Clustering (IEEE Press Series on Computational Intelligence), Hoboken: John Wiley & Sons, 2009.
[3]H. Bouchachia and E. Balaguer-Ballester, “DELA: A Dynamic Online Ensemble Learning Algorithm”, in Proc. 22nd European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN 2014), Apr. 2014, pp. 491-496.
[4]D. Leite, P. Costa Jr., and F. Gomide, “Evolving granular neural networks from fuzzy data streams”, Neural Networks, vol. 38, 2013, pp. 1-16.
[5]D. Leite, R. Ballini, Pyramo Costa Jr., and F. Gomide, “Evolving fuzzy granular modeling from nonstationary fuzzy data streams”, Evolving Systems, vol.3(2), 2012, pp. 65-79.
[6]D. Leite, R. Ballini, Pyramo Costa Jr., and F. Gomide, “Evolving fuzzy granular modeling from nonstationary fuzzy data streams”, Evolving Systems, vol.3(2), 2012, pp. 65-79.
[7]D. Kangin and P. Angelov, “Evolving clustering, classification and regression with TEDA”, in Proc. International Joint Conference on Neural Networks (IJCNN 2015), July 2015, pp. 1-8.
[8]R. Hyde and P. Angelov, “A new online clustering approach for data in arbitrary shaped clusters”, in Proc. International Conference on Cybernetics (CYBCONF 2015), June 2015, pp. 228-233.
[9]R.D. Baruah, P.P. Angelov, and D. Baruah, “Dynamically evolving clustering for data streams”, in Proc. Evolving and Adaptive Intelligent Systems (EAIS 2014), June 2014, pp. 1-6.
[10]R. Rosa, F.A.C. Gomide, D. Dovzan, I. Skrjanc, “Evolving neural network with extreme learning for system modeling”, in Proc. Evolving and Adaptive Intelligent Systems (EAIS 2014), June 2014, pp. 1-7.
[11]D. Dovzan and I. Skrjanc, “Recursive clustering based on a Gustafson-Kessel algorithm”, Evolving Systems, vol. 2(1), 2011, pp. 15-24.
[12]R.D. Baruah, P.P. Angelov, and D. Baruah, “Dynamically evolving fuzzy classifier for real-time classification of data streams”, in Proc. IEEE Int. Conf. on Fuzzy Systems (FUZZ-IEEE 2014), July 2014, pp. 383-389.
[13]R.D. Baruah and P.P. Angelov, “Online learning and prediction of data streams using dynamically evolving fuzzy approach”, in Proc. IEEE Int. Conf. on Fuzzy Systems (FUZZ-IEEE 2013), July 2013, pp. 1-8.
[14]A.P. Lemos, W.M. Caminhas, and F.A.C. Gomide, “Multivariable Gaussian Evolving Fuzzy Modeling System”, IEEE Trans. Fuzzy Systems, vol.19(1), 2011, pp. 91-104.
[15]R.D. Baruah and P.P. Angelov, “Evolving fuzzy systems for data streams: a survey”, Data Mining and Knowledge Discovery, vol.1(6), 2011, pp. 461-476.
[16]M. Pratama, S.G. Anavatti, M.J. Er, and E. Lughofer, “pClass: An Effective Classifier for Streaming Examples”, IEEE Trans. Fuzzy Systems, vol.23(2), 2015, pp. 369-386.
[17]Ye. Bodyanskiy, V. Kolodyaznhiy, and A. Stephan, “Recursive fuzzy clustering algorithms”, in Proc. 10th East West Fuzzy Colloqium, Sept. 2002, pp. 276-283.
[18]Ye. Bodyanskiy, “Computational intelligence techniques for data analysis”, Lecture Notes in Informatics, vol. P-72, 2005, pp. 15-36.
[19]Ye. Gorshkov, V. Kolodyazhniy, and Ye. Bodyanskiy, “New recursive learning algorithms for fuzzy Kohonen clustering network”, in Proc. 17th Int. Workshop on Nonlinear Dynamics of Electronic Systems, June 2009, pp. 58-61.
[20]J.C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms, N.Y.: Plenum Press, 1981.
[21]F. Klawonn and F. Hoeppner, “What is fuzzy about fuzzy clustering? Understanding and improving the concept of the fuzzifier”, Lecture Notes in Computer Science, vol. 2811, 2003, pp. 254-264.
[22]B. Kolchygin and Ye. Bodyanskiy, “Adaptive fuzzy clustering with a variable fuzzifier”, Cybernetics and System Analysis, vol. 49, no. 3, 2013, pp.176-181.
[23]A. Topchy, B. Minaei-Bidgali, A.K. Jain, and W.F. Punch, “Adaptive clustering ensembles”, in Proc.17th Int. Conf. on Pattern Recognition “ICPR 2004”, Aug. 2004, pp. 272 – 275.
[24]S. Vega-Pons and J. Ruiz-Shulcloper, “A survey of clustering ensemble algorithms”, Int. J. Pattern Recognition and Artificial Intelligence, vol. 25, no. 337, 2011, pp. 337-372.
[25]Ye. Bodyanskiy, B. Kolchygin, and I. Pliss, “Adaptive neuro-fuzzy Kohonen network with variable fuzzifier”, Int. J. Information Theories and Applications, vol. 18, no. 3, 2011, pp. 215-223.
[26]R. Krishnapuram and J.M. Keller, “A possibilistic approach to clustering”, Fuzzy Systems, vol. 1, no. 2, pp. 98-110.
[27]B.V. Kolchygin, “Ensemble of neuro-fuzzy Kohonen networks for adaptive clustering”, in Proc. 2nd Int. Sci. Conf. of Students and Young Scientists “Theoretical and Applied Aspects of Cybernetics”, Nov. 2012, pp. 176-181.
[28]Ye.V. Bodyanskiy, V.V. Volkova, and A.S. Yegorov, “Clustering of document collections based on the adaptive self-organizing neural network”, Radio Electronics, Informatics, Control, vol.1 (20), 2009, pp. 113-117.