Muhsin Hassan; Dino Isa; Rajprasad Rajkumar; Nik Ahmad Akram; Roselina Arelhi

Reducing Support Vector Machine Classification Error by Implementing Kalman Filter

Full Text (PDF, 774KB), PP.10-18

Views: 0 Downloads: 0

Author(s)

Muhsin Hassan ^1,* Dino Isa ¹ Rajprasad Rajkumar ¹ Nik Ahmad Akram ¹ Roselina Arelhi ¹

1. Department of Electrical and Electronic Engineering, Faculty of Engineering, University of Nottingham, Malaysia Campus, Jalan Broga, 43500, Semenyih, Selangor

* Corresponding author.

DOI: https://doi.org/10.5815/ijisa.2013.09.02

Received: 8 Oct. 2012 / Revised: 17 Feb. 2013 / Accepted: 4 May 2013 / Published: 8 Aug. 2013

Index Terms

Discrete Wavelet Transform (DWT), Support Vector Machine (SVM), Kalman Filter (KF), Defect classification

Abstract

The aim of this is to demonstrate the capability of Kalman Filter to reduce Support Vector Machine classification errors in classifying pipeline corrosion depth. In pipeline defect classification, it is important to increase the accuracy of the SVM classification so that one can avoid misclassification which can lead to greater problems in monitoring pipeline defect and prediction of pipeline leakage. In this paper, it is found that noisy data can greatly affect the performance of SVM. Hence, Kalman Filter + SVM hybrid technique has been proposed as a solution to reduce SVM classification errors. The datasets has been added with Additive White Gaussian Noise in several stages to study the effect of noise on SVM classification accuracy. Three techniques have been studied in this experiment, namely SVM, hybrid of Discrete Wavelet Transform + SVM and hybrid of Kalman Filter + SVM. Experiment results have been compared to find the most promising techniques among them. MATLAB simulations show Kalman Filter and Support Vector Machine combination in a single system produced higher accuracy compared to the other two techniques.

Cite This Paper

Muhsin Hassan, Dino Isa, Rajprasad Rajkumar, Nik Ahmad Akram, Roselina Arelhi, "Reducing Support Vector Machine Classification Error by Implementing Kalman Filter", International Journal of Intelligent Systems and Applications(IJISA), vol.5, no.9, pp.10-18, 2013. DOI:10.5815/ijisa.2013.09.02

Reference

[1]Ming Ge, R. Du, Cuicai Zhang, Yangsheng Xu, “Fault diagnosis using support vector machine with an application in sheet metal stamping operations”. Mechanical Systems and Signal Processing 18, 2004, pp. 143-159.

[2]D. Isa, R. Rajkumar, KC Woo, “Pipeline Defect Detection Using Support Vector Machine”, 6th WSEAS International conference on circuits,systems, electronics, control and signal processing, Cairo, Egypy, Dec 2007. pp.162-168.

[3]M. Hassan, R. Rajkumar, D. Isa, and R. Arelhi “Kalman Filter as a Pre-processing technique to improve Support Vector Machine”, Sustainable Utilization and Development in Engineering and Technology (STUDENT), 2011, Oct 2011, DOI: 10.1109/STUDENT.2011.6089335.

[4]Rajpoot, K.M, and Rajpoot, N.M, “Wavelets and support vector machines for texture classification”, Multitopic Conference, 2004. Proceeding of INMIC 2004, 8th International, pp.328-333.

[5]Lee, Kyungmi and Estivill-Castro, Vladamir, “Support vector machine classification of ultrasonic shaft inspection data using discrete wavelet transform”, Proceddings of the International Conference on Machine Learning, MLMTA’04, 2004.

[6]Sandeep Chaplot, L.M. Patnaik, and N.R. Jagannathan, “Classification of magnetic resonance brain images using wavelets as input to support vector machine and neural network”, Biomedical Signal Processing Control 1, (2006), pp.86-92.

[7]Lozev, M. G., Smith, R. W. and Grimmett, B. B., “Evaluation of Methods for Detecting and Monitoring of Corrosion Damage in Risers”, Journal of Pressure Vessel Technology. Transactions of the ASME, Vol. 127, 2005.

[8]Anonymous (2009, April 1)“Gazprom reduces gas supplies by 40% to Balkans after pipeline rupture”, [Online]. Available: www.chinaview.cn.

[9]Lebsack, S.,“Non-invasive inspection method for unpiggable pipeline sections”, Pipeline & Gas Journal, 59, 2002.

[10]Demma A., Cawley P., Lowe M., Roosenbrand A. G., Pavlakovic B., “The reflection of guided waves from notches in pipes: A guide for interpreting corrosion measurements”, NDT & E International. Vol. 37, Issue 3, 167-180. Elsevier, 2004.

[11]Wassink and Engel, Applus RTD Rotterdam, The Netherland, (2008, April 8), “Comparison of Guided waves inspection and alternative strategies for inspection of insulated pipelines”, Guided Wave Seminar, Italian Association of Non-destructive Monitoring and diagnostics (AIPnD).Available:www.aipnd.it/onde-guidate/GWseminar.htm.

[12]Anonymous “Teletest Focus Goes Permanent”, Plan Integrity Limited, Available: www.plantintegrity.co.uk

[13]Dino Isa, Rajprasad Rajkumar, “Pipeline defect prediction using long range ultrasonic testing and intelligent processing” Malaysian International NDT Conference and Exhibition, MINDTCE 09, Kuala Lumpur, July 2009.

[14]Rizzo, P., Bartoli, I., Marzani, A. and Lanza di Scalea, F.,“Defect Classification in Pipes by Neural Networks Using Multiple Guided Ultrasonic Wave Features Extracted After Wavelet Processing”, ASME Journal of Pressure Vessel Technology. Special Issue on NDE of Pipeline Structures, 127(3), 2005, pp. 294-303.

[15]Cau F., Fanni A., Montisci A., Testoni P. and Usai M., “Artificial Neural Network for Non-Destructive evaluation with Ultrasonic waves in not Accessible Pipes”, In: Industry Applications Conference, 2005. Fortieth IAS Annual Meeting, Vol. 1, 2005, 685-692.

[16]Wang, C.H., Rose, L.R.F., “Wave reflection and transmission in beams containing delamination and inhomogeneity”. J. Sound Vib. 264, 2003, pp.851–872.

[17]K.L. Chin and M. Veidt, “Pattern recognition of guided waves for damage evaluation in bars”, Pattern Recognition Letters 30 , 2009, pp.321–330.

[18]V. Vapnik. The Nature of Statistical Learning Theory, 2nd edition, Springer, 1999.

[19]Klaus-Robert Müller, Sebastian Mika, Gunnar Rätsch, Koji Tsuda, and Bernhard Schölkopf, “An Introduction To Kernel-Based Learning Algorithms”, IEEE Transactions On Neural Networks, Vol. 12, No. 2, March 2001 181

[20]Burges, Christopher J.C. “A Tutorial on Support Vector Machines for Pattern Recognition”.Bell Laboratories, Lucent Technologies. Data Mining and Knowledge Discovery, 1998.

[21]Haykin, Simon. “Neural Networks. A Comprehensive Foundation”, 2nd Edition, Prentice Hall, 1999

[22]Gunn, Steve. “Support Vector Machines for Classification and Regression”, University of Southampton ISIS, 1998, [Online] Available: http://www.ecs.soton.ac.uk/~srg/publications/pdf/SVM.pdf.

[23]Law, Martin. “A simple Introduction to Support Vector Machines”, Lecture for CSE 802, Department of Computer Science and Engineering, Michigan State University. Available: www.cse.msu.edu/~lawhiu/intro_SVM_new.ppt.

[24]Kecman, Vojislav, “Support Vector machines Basics”, School Of Engineering, Report 616, The University of Auckland, 2004.

[25]Sweeney, N., “Air-to-air missile vector scoring”, Control Applicationcs (CCA), IEEE Control Systems Society, 2011 Multi-Conference on Systems and Controls, 2011, pp. 579-586.

[26]Gipson, J., 2012, ‘Air-to-air missile enhanced scoring with Kalman smoothing’, Master Thesis, Air Force Institute of Technlogy, Wright-Patterson Air Force Base, Ohio.

[27]Gaylor, D.E, 2003, ‘Integrated GPS/INS Navigation System Design for Autoomous Spacecraft Rendezvous’, Phd Thesis, The University of Tezas, Austin.

[28]Huang, Shian-Chang, “Combining Extended Kalman Filters and Support Vector Machines for Online Price Forecasting”, Advances in Intteligent System Research, Proceedings of the 9th Joint Conference on Information Sciences (JCIS), 2006.

[29]Lucie Daubigney and Oliver Pietquin, “Single-trial P300 detection with Kalman Filtering and SVMs”, ESANN 2011 Proceeding, European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, 2011.

[30]Welch G. and Bishop G., 2006, “An introduction to the Kalman Filter”, Department of Computer Science, University of North Carolina, viewed.

[31]Grewal M.S. and Andrews A.P., 2001, Kalman Filtering: Theory and Practice Using MATLAB, 2nd Edition, A Wiley-Interscience Publication, New York.

[32]Shoudong Huang, “Understanding Extended Kalman Filter – Part II: Multidimensional Kalman Filter” March 2009, [Online] Available: http://services.eng.uts.edu.au/~sdhuang/Kalman%20Filter_Shoudong.pdf

[33]Mallat, S. A Wavelet Tour of Signal Processing, 1999, Elsevier.

[34]Anonymous “Discrete Wavelet Transform”, Available: www.plant http://en.wikipedia.org/wiki/Discrete_wavelet_transformintegrity.co.uk.

[35]Lee, K. and Estivill-Castro, V., Classification of ultrasonic shaft inspection data using discrete wavelet transform. In: Proceedings of the Third IASTED International Conferences on Artificial Intelligence and application, ACTA Press. pp. 673-678.

[36]Lin C.J, Hong S.J, and Lee C.Y, “Using least squares support vector machines for adaptive communication channel equalization”, International Journal of Applied Science and Engineering, 2005, Vol.3, pp.51-59.

[37]Sebald, D.J.and Bucklew, J.A., “Support Vector Machine Techniques for Nonlinear Equalization”, IEEE Transaction of Signal Processing, Vol. 48, No.11, 2000, pp.3217-3226.

International Journal of Intelligent Systems and Applications (IJISA)