Risikat Folashade Adebiyi; Habeeb Bello-Salau; Adeiza James Onumanyi; Bashir Olaniyi Sadiq; Abdulfatai Dare Adekale; Busayo Hadir Adebiyi; Emmanuel Adewale Adedokun

Performance Analysis of Various Image Feature Extractor Filters for Pothole Anomaly Classification

Full Text (PDF, 457KB), PP.25-37

Views: 0 Downloads: 0

Author(s)

Risikat Folashade Adebiyi ^1,* Habeeb Bello-Salau ¹ Adeiza James Onumanyi ² Bashir Olaniyi Sadiq ¹ Abdulfatai Dare Adekale ¹ Busayo Hadir Adebiyi ¹ Emmanuel Adewale Adedokun ¹

1. Department of Computer Engineering, Ahmadu Bello University, Zaria, 1045, Nigeria

2. Council for Scientific and Industrial Research (CSIR), Pretoria, South Africa

* Corresponding author.

DOI: https://doi.org/10.5815/ijigsp.2024.01.03

Received: 17 Jan. 2023 / Revised: 12 May 2023 / Accepted: 21 Jun. 2023 / Published: 8 Feb. 2024

Index Terms

Classifier, Feature, Image, Machine-Learning, Potholes

Abstract

Machine learning (ML) classifiers have lately gained traction in the realm of intelligent transportation systems as a means of enhancing road navigation while also assisting and increasing automotive user safety and comfort. The feature extraction stage, which defines the performance accuracy of the ML classifier, is critical to the success of any ML classifiers used. Nonetheless, the efficacy of various ML feature extractor filters on image data of road surface conditions obtained in a variety of illumination settings is uncertain. Thus, an examination of eight different feature extractor filters, namely Auto colour, Binary filter, Edge Detection, Fuzzy Color Texture Histogram Filter (FCTH), J-PEG Color, Gabor filter, Pyramid of Gradients (PHOG), and Simple Color, for extracting pothole anomalies feature from road surface conditions image data acquired under three environmental scenarios, namely bright, hazy, and dim conditions, prior classification using J48, JRip, and Random Forest ML models. According to the results of the experiments, the auto colour image filter is better suitable for extracting features for categorizing road surface conditions image data in bright light circumstances, with an average classification accuracy of roughly 96%. However, with a classification accuracy of around 74%, the edge detection filter is best suited for extracting features for the classification of road surface conditions image data captured in hazy light circumstances. The autocolor filter, on the other hand, has an accuracy of roughly 87% when it comes to classifying potholes in low-light conditions. These findings are crucial in the selection of feature extraction filters for use by ML classifiers in the development of a robust autonomous pothole detection and classification system for improved navigation on anomalous roads and possible integration into self-driving cars.

Cite This Paper

Risikat Folashade Adebiyi, Habeeb Bello-Salau, Adeiza James Onumanyi, Bashir Olaniyi Sadiq, Abdulfatai Dare Adekale, Busayo Hadir Adebiyi, Emmanuel Adewale Adedokun, "Performance Analysis of Various Image Feature Extractor Filters for Pothole Anomaly Classification", International Journal of Image, Graphics and Signal Processing(IJIGSP), Vol.16, No.1, pp. 25-37, 2024. DOI:10.5815/ijigsp.2024.01.03

Reference

[1]M. Nwafor and O. O. and, “Road transportation service in Nigeria: Problems and prospects,” aspjournals.org, vol. 4, no. 3, pp. 104–115, 2019, Accessed: Jan. 09, 2023. [Online]. Available: https://aspjournals.org/ajemr/index.php/ajemr/article/view/1
[2]P. C. Onokala and C. J. Olajide, “Problems and Challenges Facing the Nigerian Transportation System Which Affect Their Contribution to the Economic Development of the Country in the 21st Century,” in Transportation Research Procedia, 2020, pp. 2945–2962. doi: 10.1016/j.trpro.2020.08.189.
[3]R. Fan, S. Guo, L. Wang, M. B. preprint arXiv:2203.02355, and 2022, “Computer-aided road inspection: Systems and algorithms,” arxiv.org, 2022, Accessed: Jan. 10, 2023. [Online]. Available: https://arxiv.org/abs/2203.02355
[4]M. H. Yousaf, K. Azhar, F. Murtaza, and F. Hussain, “Visual analysis of asphalt pavement for detection and localization of potholes,” Advanced Engineering Informatics, vol. 38, pp. 527–537, 2018, doi: 10.1016/j.aei.2018.09.002.
[5]S. Nienaber, “Detecting potholes with monocular computer vision: A performance evaluation of techniques,” 2016, Accessed: Jan. 16, 2023. [Online]. Available: http://scholar.sun.ac.za/handle/10019.1/98456
[6]O. Olufemi Jacob, I. Callistus Chukwudi, E. Oforegbunam Thaddeus, and E. Ejem Agwu, “Analysis of the Extent of Overloading on the Nigerian Highways,” International Journal of Transportation Engineering and Technology, vol. 6, no. 1, p. 22, 2020, doi: 10.11648/j.ijtet.20200601.14.
[7]S. K. Ryu, T. Kim, and Y. R. Kim, “Image-Based Pothole Detection System for ITS Service and Road Management System,” Math Probl Eng, vol. 2015, 2015, doi: 10.1155/2015/968361.
[8]M. Gao, X. Wang, S. Zhu, and P. Guan, “Detection and Segmentation of Cement Concrete Pavement Pothole Based on Image Processing Technology,” Math Probl Eng, vol. 2020, 2020, doi: 10.1155/2020/1360832.
[9]H. Bello-Salau, A. J. Onumanyi, R. F. Adebiyi, E. A. Adedokun, and G. P. Hancke, “Performance Analysis of Machine Learning Classifiers for Pothole Road Anomaly Segmentation,” in IEEE International Symposium on Industrial Electronics, 2021. doi: 10.1109/ISIE45552.2021.9576214.
[10]C. Wu et al., “An automated machine-learning approach for road pothole detection using smartphone sensor data,” Sensors (Switzerland), vol. 20, no. 19, pp. 1–23, 2020, doi: 10.3390/s20195564.
[11]H. Bello-Salau, A. J. Onumanyi, A. T. Salawudeen, M. B. Mu’Azu, and A. M. Oyinbo, “An Examination of Different Vision based Approaches for Road Anomaly Detection,” in 2019 2nd International Conference of the IEEE Nigeria Computer Chapter, NigeriaComputConf 2019, 2019. doi: 10.1109/NigeriaComputConf45974.2019.8949646.
[12]C. Acharjee, S. Singhal, and S. Deb, “Machine Learning Approaches for Rapid Pothole Detection from 2D Images,” in Communications in Computer and Information Science, Springer Science and Business Media Deutschland GmbH, 2020, pp. 108–119. doi: 10.1007/978-3-030-66763-4_10.
[13]C. Theoharatos, A. Makedonas, D. Kastaniotis, A.-S. Demetris, and V. Vassalos, “RoadEye: Road Condition Monitoring using Computer Vision and Deep Learning Techniques,” Information, Intelligence, Systems and Applications, vol. 1, no. 1, pp. 59–63, May 2020, doi: 10.26220/IISA.3326.
[14]A. Mohammed, A. Oyinbo, S. Zubair, and E. Michael, “A Review of the Different Proposed Image Detection Techniques for Road Anomalies Detection,” Nigerian Society of Engineers, Minna Branch. Nigeria, 2021, Accessed: Jul. 17, 2023. [Online]. Available: http://repository.futminna.edu.ng:8080/jspui/handle/123456789/13607
[15]U. Bhatt, S. Mani, E. Xi, and J. Z. Kolter, “Intelligent Pothole Detection and Road Condition Assessment,” in Computers and Society, 2017.
[16]P. Miracle Udah et al., “Development of an Intelligent Road Anomaly Detection System for Autonomous Vehicles,” futminna.edu.ng, 2023, doi: 10.25046/aj080201.
[17]C. Koch and I. Brilakis, “Pothole detection in asphalt pavement images,” Advanced Engineering Informatics, vol. 25, no. 3, pp. 507–515, Aug. 2011, doi: 10.1016/j.aei.2011.01.002.
[18]A. Ellahyani, M. El Ansari, and I. El Jaafari, “Traffic sign detection and recognition based on random forests,” Appl Soft Comput, vol. 46, pp. 805–815, Sep. 2016, doi: 10.1016/j.asoc.2015.12.041.
[19]C. Wu et al., “An Automated Machine-Learning Approach for Road Pothole Detection Using Smartphone Sensor Data,” Sensors, vol. 20, no. 19, p. 5564, Sep. 2020, doi: 10.3390/s20195564.
[20]S. Sattar, S. Li, and M. Chapman, “Developing a near real-time road surface anomaly detection approach for road surface monitoring,” Measurement (Lond), vol. 185, p. 109990, Nov. 2021, doi: 10.1016/j.measurement.2021.109990.
[21]B. Al-Shargabi, M. Hassan, T. A.-R.-T. Journal, and 2020, “A novel approach for the detection of road speed bumps using accelerometer sensor,” TEM Journal , vol. 9, no. 2, pp. 469–476, 2020, Accessed: Jan. 10, 2023. [Online]. Available: https://www.ceeol.com/search/article-detail?id=869810
[22]H. SALAU, A. ONUMANYİ, and … A. A., “A survey of accelerometer-based techniques for road anomalies detection and characterization,” International Journal of Engineering Science and Application, vol. 3, no. 1, pp. 8–20, 2019, Accessed: Jan. 10, 2023. [Online]. Available: https://dergipark.org.tr/en/pub/ijesa/issue/44241/483920
[23]J. Dib, K. Sirlantzis, and G. Howells, “A Review on Negative Road Anomaly Detection Methods,” IEEE Access, vol. 8, pp. 57298–57316, 2020, doi: 10.1109/ACCESS.2020.2982220.
[24]A. Dhiman and R. Klette, “Pothole Detection Using Computer Vision and Learning,” IEEE Transactions on Intelligent Transportation Systems, vol. 21, no. 8, pp. 3536–3550, Aug. 2020, doi: 10.1109/TITS.2019.2931297.
[25]N.-D. Hoang, T.-C. Huynh, and V.-D. Tran, “Computer Vision-Based Patched and Unpatched Pothole Classification Using Machine Learning Approach Optimized by Forensic-Based Investigation Metaheuristic,” Complexity, vol. 2021, pp. 1–17, Sep. 2021, doi: 10.1155/2021/3511375.
[26]H. Bello-Salau, A. M. Aibinu, E. N. Onwuka, J. J. Dukiya, and A. J. Onumanyi, “Image processing techniques for automated road defect detection: A survey,” Proceedings of the 11th International Conference on Electronics, Computer and Computation, ICECCO 2014, Dec. 2014, doi: 10.1109/ICECCO.2014.6997556.
[27]A. Sinha, S. Banerji, and C. Liu, “Novel gabor-PHOG features for object and scene image classification,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 7626 LNCS, pp. 584–592, 2012, doi: 10.1007/978-3-642-34166-3_64.
[28]D. Arya, A. Kumar, and H. L. Mandoria, “Classification Of Satellite Images Using Glcm & Gabor Filter, Fuzzy C Means And Svm.,” International Research Journal of Engineering and Technology (IRJET), vol. 5(4), 2018, Accessed: Aug. 20, 2022. [Online]. Available: https://www.academia.edu/download/56800812/IRJET-V5I4166.pdf
[29]R. Ponnusamy, S. Sathiamoorthy, and R. Visalakshi, “An efficient method to classify GI tract images from WCE using visual words,” International Journal of Electrical and Computer Engineering, vol. 10, no. 6, pp. 5678–5686, 2020, doi: 10.11591/ijece.v10i6.pp5678-5686.
[30]P. P. Saragni, B. S. P. Mishra, and S. Dehuri, “Pyramid histogram of oriented gradients based human ear identification,” International Journal of Control Theory and Applications, vol. 10, no. 15, pp. 125–133, 2017, Accessed: Aug. 20, 2022. [Online]. Available: https://www.researchgate.net/profile/Partha-Sarangi-2/publication/319234384_Pyramid_Histogram_of
_Oriented_Gradients_based_Human_Ear_Identification_Pyramid_Histogram_of_Oriented_Gradients_based_Human_Ear_
Identification/links/599cac33a6fdcc50034cacbc/Pyrami
[31]S. Anand, S. Gupta, V. Darbari, and S. Kohli, “Crack-pot: Autonomous Road Crack and Pothole Detection,” in 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018, 2019. doi: 10.1109/DICTA.2018.8615819.
[32]H. K. I. S. Lakmal and M. B. Dissanayake, “Pothole Detection with Image Segmentation for Advanced Driver Assisted Systems,” in Proceedings of 2020 IEEE International Women in Engineering (WIE) Conference on Electrical and Computer Engineering, WIECON-ECE 2020, 2020, pp. 308–311. doi: 10.1109/WIECON-ECE52138.2020.9398036.
[33]D. Abin, M. Solanki, N. Waghchaure, S. Shivthare, and R. Augustine, “Machine Learning approach for Defect Identification in Machinery parts,” in 2019 IEEE Bombay Section Signature Conference, IBSSC 2019, 2019. doi: 10.1109/IBSSC47189.2019.8973021.
[34]J. Chaki, N. Dey, L. Moraru, and F. Shi, “Fragmented plant leaf recognition: Bag-of-features, fuzzy-color and edge-texture histogram descriptors with multi-layer perceptron,” Optik (Stuttg), vol. 181, pp. 639–650, 2019, doi: 10.1016/j.ijleo.2018.12.107.
[35]M. Alamgeer et al., “Optimal Fuzzy Wavelet Neural Network based Road Damage Detection,” IEEE Access, 2023, doi: 10.1109/ACCESS.2023.3283299.
[36]E. da S. Vaz, L. F. Gasparello, L. T. de Gouveia, and L. J. Senger, “DETECTING DAMAGE IN ROADS USING CONVOLUTIONAL NEURAL NETWORKS,” Iberoamerican Journal of Applied Computing, vol. 11, no. 1, Jun. 2023, Accessed: Jul. 17, 2023. [Online]. Available: https://revistas.uepg.br/index.php/ijac/article/view/21916
[37]D. Shiotsuka, K. Matsushima, and O. Takahashi, “Crack Detection Using Spectral Clustering: Self-Tuning Considering Crack Feature and Connections,” in 2019 International Conference on Mechatronics, Robotics and Systems Engineering (MoRSE)107, IEEE, 2019, pp. 107–111.
[38]W. Jiang, T. Z. Shen, J. Zhang, Y. Hu, and X. Y. Wang, “Gabor wavelets for image processing,” in Proceedings - ISECS International Colloquium on Computing, Communication, Control, and Management, CCCM 2008, 2008, pp. 110–114. doi: 10.1109/CCCM.2008.62.
[39]B. Desai, U. Kushwaha, and S. Jha, “Image filtering-techniques algorithms and applications,” GIS Science Journal, vol. 7, no. 11, 2020, Accessed: Aug. 21, 2022. [Online]. Available: https://www.researchgate.net/profile/Shivam-Jha-7/publication/346583845_Image_Filtering_-Techniques_Algorithm_and_Applications/links/5fc8ad9a45851568d1370245/Image-Filtering-Techniques-Algorithm-and-Applications.pdf
[40]S. A. Chatzichristofis and Y. S. Boutalis, “FCTH: Fuzzy Color and texture histogram a low level feature for accurate image retrieval,” in WIAMIS 2008 - Proceedings of the 9th International Workshop on Image Analysis for Multimedia Interactive Services, 2008, pp. 191–196. doi: 10.1109/WIAMIS.2008.24.

International Journal of Image, Graphics and Signal Processing (IJIGSP)