Transfer Learning with EfficientNetV2 for Diabetic Retinopathy Detection

PDF (424KB), PP.54-60

Views: 0 Downloads: 0

Author(s)

Michael Chi Seng Tang 1,* Huong Yong Ting 1 Abdulwahab Funsho Atanda 1 Kee Chuong Ting 2

1. Design and Technology Centre University of Technology Sarawak, 96000 Sibu, Sarawak, Malaysia

2. School of Engineering and Technology, University of Technology Sarawak, 96000 Sibu, Sarawak, Malaysia

* Corresponding author.

DOI: https://doi.org/10.5815/ijem.2024.06.05

Received: 13 Mar. 2024 / Revised: 3 Jul. 2024 / Accepted: 20 Aug. 2024 / Published: 8 Dec. 2024

Index Terms

Diabetic retinopathy detection, deep learning, convolutional neural network, medical imaging, image classification

Abstract

This paper investigates the application of EfficientNetV2, an advanced variant of EfficientNet, in diabetic retinopathy (DR) detection, a critical area in medical image analysis. Despite the extensive use of deep learning models in this domain, EfficientNetV2’s potential remains largely unexplored. The study conducts comprehensive experiments, comparing EfficientNetV2 with established models like AlexNet, GoogleNet, and various ResNet architectures. A dataset of 3662 images was used to train the models. Results indicate that EfficientNetV2 achieves competitive performance, particularly excelling in sensitivity, a crucial metric in medical image classification. With a high area under the curve (AUC) value of 98.16%, EfficientNetV2 demonstrates robust discriminatory ability. These findings underscore its potential as an effective tool for DR diagnosis, suggesting broader applicability in medical image analysis. Moreover, EfficientNetV2 contains more layers than AlexNet, GoogleNet, and ResNet architecture, which makes EfficientNetV2 the superior deep learning model for DR detection. Future research could focus on optimizing the model for specific clinical contexts and validating its real-world effectiveness through large-scale clinical trials.

Cite This Paper

Michael Chi Seng Tang, Huong Yong Ting, Abdulwahab Funsho Atanda, Kee Chuong Ting, "Transfer Learning with EfficientNetV2 for Diabetic Retinopathy Detection", International Journal of Engineering and Manufacturing (IJEM), Vol.14, No.6, pp. 54-60, 2024. DOI:10.5815/ijem.2024.06.05

Reference

[1]M. C. S. Tang, S. S. Teoh, H. Ibrahim, and Z. Embong, “A deep learning approach for the detection of neovascularization in fundus images using transfer learning,” IEEE Access, vol. 10, pp. 20247–20258, 2022, doi: 10.1109/ACCESS.2022.3151644.
[2]M. C. S. Tang, S. S. Teoh, H. Ibrahim, and Z. Embong, “Neovascularization detection and localization in fundus images using deep learning,” Sensors, vol. 21, no. 16, p. 5327, Aug. 2021, doi: 10.3390/s21165327.
[3]M. C. S. Tang, S. S. Teoh, and H. Ibrahim, “Retinal vessel segmentation from fundus images using DeepLabv3+,” in 2022 IEEE 18th International Colloquium on Signal Processing & Applications (CSPA), May 2022, pp. 377–381. doi: 10.1109/CSPA55076.2022.9781891.
[4]M. C. S. Tang and S. S. Teoh, “Blood vessel segmentation in fundus images using hessian matrix for diabetic retinopathy detection,” in 2020 11th IEEE Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON), Nov. 2020, pp. 0728–0733. doi: 10.1109/IEMCON51383.2020.9284931.
[5]M. C. S. Tang and S. S. Teoh, “Brain Tumor Detection from MRI Images Based on ResNet18,” in 2023 6th International Conference on Information Systems and Computer Networks (ISCON), Mar. 2023, pp. 1–5. doi: 10.1109/ISCON57294.2023.10112025.
[6]I. Arias-Serrano et al., “Artificial intelligence based glaucoma and diabetic retinopathy detection using MATLAB — retrained AlexNet convolutional neural network,” F1000Research, vol. 12, p. 14, Jan. 2023, doi: 10.12688/f1000research.122288.1.
[7]B. Shi et al., “GoogLeNet-based Diabetic-retinopathy-detection,” in 2022 14th International Conference on Advanced Computational Intelligence (ICACI), Jul. 2022, pp. 246–249. doi: 10.1109/ICACI55529.2022.9837677.
[8]P. Junjun, Y. Zhifan, S. Dong, and Q. Hong, “Diabetic Retinopathy Detection Based on Deep Convolutional Neural Networks for Localization of Discriminative Regions,” in Proceedings - 8th International Conference on Virtual Reality and Visualization, ICVRV 2018, Oct. 2018, pp. 46–52. doi: 10.1109/ICVRV.2018.00016.
[9]N. M. A.-M. M. Al-Moosawi and R. S. Khudeyer, “ResNet-34/DR: A Residual Convolutional Neural Network for the Diagnosis of Diabetic Retinopathy,” Informatica, vol. 45, no. 7, pp. 115–124, Dec. 2021, doi: 10.31449/inf.v45i7.3774.
[10]C.-L. Lin and K.-C. Wu, “Development of revised ResNet-50 for diabetic retinopathy detection,” BMC Bioinformatics, vol. 24, no. 1, p. 157, Apr. 2023, doi: 10.1186/s12859-023-05293-1.
[11]S. Karthika and M. Durgadevi, “Improved ResNet_101 assisted attentional global transformer network for automated detection and classification of diabetic retinopathy disease,” Biomed. Signal Process. Control, vol. 88, p. 105674, Feb. 2024, doi: 10.1016/j.bspc.2023.105674.
[12]S. Gulati, K. Guleria, and N. Goyal, “Classification of Diabetic Retinopathy using pre-trained Deep Learning Model- DenseNet 121,” in 2023 14th International Conference on Computing Communication and Networking Technologies (ICCCNT), Jul. 2023, pp. 1–6. doi: 10.1109/ICCCNT56998.2023.10308181.
[13]S. R. Rath, “Diabetic Retinopathy 224x224 (2019 Data),” 2020. https://www.kaggle.com/datasets/sovitrath/diabetic-retinopathy-224x224-2019-data (accessed Feb. 02, 2024).
[14]M. Tan and Q. V. Le, “EfficientNetV2: Smaller Models and Faster Training,” Proc. Mach. Learn. Res., vol. 139, pp. 10096–10106, 2021.
[15]A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet classification with deep convolutional neural networks,” Commun. ACM, vol. 60, no. 6, pp. 84–90, May 2017, doi: 10.1145/3065386.
[16]C. Szegedy et al., “Going deeper with convolutions,” in 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2015, vol. 07-12-June, pp. 1–9. doi: 10.1109/CVPR.2015.7298594.
[17]K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2016, vol. 2016-Decem, pp. 770–778. doi: 10.1109/CVPR.2016.90.
[18]G. Huang, Z. Liu, L. Van Der Maaten, and K. Q. Weinberger, “Densely connected convolutional networks,” in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jul. 2017, vol. 2017-Janua, pp. 2261–2269. doi: 10.1109/CVPR.2017.243.