International Journal of Image, Graphics and Signal Processing (IJIGSP)
IJIGSP Vol. 16, No. 4, 8 Aug. 2024
Cover page and Table of Contents: PDF (size: 1275KB)
CRDL-PNet: An Efficient DeepLab-based Model for Segmenting Polyp Colonoscopy Images
PDF (1275KB), PP.15-29
Views: 0 Downloads: 0
Author(s)
Anita Murmu
1,*
Piyush Kumar
1
Shrikant Malviya
2
Index Terms
Colonoscopy, deep learning, segmentation, polyp detection, boundary box
Abstract
Colorectal cancers are the third-largest kind of cancer in the world. However, detecting and removing precursor polyps with adenomatous cells using optical colonoscopy images helps to prevent this type of cancer. Moreover, hyperplastic polyps are benign cancers; adenomatous polyps are more likely to grow into cancerous tumors. Therefore, the detection and segmentation of polyps provide further histological evaluation. However, the main challenge is the extensive range of infected polyp features inside the colon and the lack of contrast between normal and infected areas. To solve these issues, the proposed novel Customized ResNet50 with DeepLabV3Plus Network (CRDL-PNet) model provided a scheme for segmenting polyps from colonoscopy images. The customized ResNet50 extracted features from polyp colonoscopy images. Furthermore, Atrous Spatial Pyramid Pooling (ASPP) is used to handle scale variation during training and improve feature selection maps in an upsampling layer. Additionally, the Gateaux Derivatives (GD) approach is used to segment boundary boxes of polyp regions. The proposed method has been evaluated on four datasets, namely the Kvasir-SEG, ETIS-PolypLaribDB, CVC-ClinicDB, and CVC-ColonDB datasets, for segmenting and detecting polyps. The simulation results have been examined by evaluation metrics, such as accuracy, Intersection-Over-Union (IOU), mean IOU, precision, recall, F1-score, dice, Jaccard, and Mean Process Time per Frame (MPTF) for proper validation. The proposed scheme outperforms the existing State-Of-The-Arts (SOTA) model on the same polyp datasets.
Cite This Paper
Anita Murmu, Piyush Kumar, Shrikant Malviya, "CRDL-PNet: An Efficient DeepLab-based Model for Segmenting Polyp Colonoscopy Images", International Journal of Image, Graphics and Signal Processing(IJIGSP), Vol.16, No.4, pp. 15-29, 2024. DOI:10.5815/ijigsp.2024.04.02
Reference
[1]Bray F, Soerjomataram I, “The changing global burden of cancer: transitions in human development and implications for cancer prevention and control,” Cancer: disease control priorities, vol. 3, pp. 23-44, 2015.
[2]Yang X, Wei Q, Zhang C, Zhou K, Kong L, Jiang W, “Colon polyp detection and segmentation based on improved MRCNN,” IEEE Transactions on Instrumentation and Measurement, vol. 70, pp. 1-10, 2020.
[3]Sharma P, Gautam A, Maji P, Pachori R B, Balabantaray B K, “Li-SegPNet: Encoder-decoder Mode Lightweight Segmentation Network for Colorectal Polyps Analysis,” IEEE Transactions on Biomedical Engineering, vol. 70, no. 4, pp. 1330-1339, 2023.
[4]Gessl I, Waldmann E, Penz D, Majcher B, Dokladanska A, Hinterberger A, Ferlitsch M, “Evaluation of adenomas per colonoscopy and adenomas per positive participant as new quality parameters in screening colonoscopy,” Gastrointestinal endoscopy, vol. 89, no. 3, pp. 496-502, 2019.
[5]Bae S H, Yoon K J, “Polyp detection via imbalanced learning and discriminative feature learning,” IEEE Transactions on medical imaging, vol. 34, no. 11, pp. 2379-2393, 2015.
[6]Murmu A, Kumar P, “A novel Gateaux Derivatives with Efficient DCNN-ResUNet Method for Segmenting Multi-class Brain Tumor” Medical and Biological Engineering and Computing, 2023. 10.1007/s11517-023-02824-z.
[7]Murmu A, Kumar P, “Deep learning model-based segmentation of medical diseases from MRI and CT images,” In TENCON 2021 IEEE Region 10 Conference (TENCON), pp. 608-613, 2021.
[8]Wu H, Zhao Z, Zhong J, Wang W, Wen Z, Qin J, “Polypseg+: A lightweight context-aware network for real-time polyp segmentation,” IEEE Transactions on Cybernetics, vol. 53, no. 4, pp. 2610-2621, 2023.
[9]Isensee F, Petersen J, Klein A, Zimmerer D, Jaeger P F, Kohl S, Maier-Hein K H, “nnU-Net: Self-adapting framework for U-Net-based medical image segmentation,” Nature Methods, vol. 18, no. 2, pp. 203–211, 2021.
[10]Qadir H A, Shin Y, Solhusvik J, Bergsland J, Aabakken L, Balasingham I, “Toward real-time polyp detection using fully CNNs for 2D Gaussian shapes prediction,” Medical Image Analysis, vol. 68, pp. 101897, 2021.
[11]Mangotra H, Goel N, “Effect of selection bias on automatic colonoscopy polyp detection” Biomedical Signal Processing and Control, vol. 85, pp. 104915, 2023.
[12]Shi J H, Zhang Q, Tang Y H, Zhang Z Q, “Polyp-Mixer: An Efficient Context-Aware MLP-Based Paradigm for Polyp Segmentation,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 33, no. 1, pp. 30-42, 2023.
[13]Chen B L, Wan J J, Chen T Y, Yu Y T, Ji M, “A self-attention based faster R-CNN for polyp detection from colonoscopy images,” Biomedical Signal Processing and Control, vol. 70, pp. 103019, 2021.
[14]Yue G, Li S, Cong R, Zhou T, Lei B, Wang T, “Attention-guided pyramid context network for polyp segmentation in colonoscopy images,” IEEE Transactions on Instrumentation and Measurement, vol. 72, pp. 1-13, 2023.
[15]Adjei P E, Lonseko Z M, Du W, Zhang H, Rao N, “Examining the effect of synthetic data augmentation in polyp detection and segmentation,” International Journal of Computer Assisted Radiology and Surgery, vol. 17, no. 7, pp. 1289-1302, 2022.
[16]Banik D, Roy K, Bhattacharjee D, Nasipuri M, Krejcar O, “Polyp-Net: A multimodel fusion network for polyp segmentation,” IEEE Transactions on Instrumentation and Measurement, vol. 70, pp. 1-12, 2020.
[17]Yue G, Han W, Li S, Zhou T, Lv J, Wang T, “Automated polyp segmentation in colonoscopy images via deep network with lesion-aware feature selection and refinement,” Biomedical Signal Processing and Control, vol. 78, pp. 103846, 2022.
[18]Jin, Y., Hu, Y., Jiang, Z., & Zheng, Q. (2022). Polyp segmentation with convolutional MLP. The Visual Computer, 1-19.
[19]Zhang W, Fu C, Zheng Y, Zhang F, Zhao Y, Sham C W, “HSNet: A hybrid semantic network for polyp segmentation,” Computers in biology and medicine, vol. 150, pp. 106173, 2022.
[20]Mohapatra S, Pati G K, Mishra M, Swarnkar T, “UPolySeg: A U-Net-Based Polyp Segmentation Network Using Colonoscopy Images,” Gastroenterology Insights, vol. 13, no. 3, pp. 264-274, 2022.
[21]Yeung M, Sala E, Schönlieb C B, Rundo L, “Focus U-Net: A novel dual attention-gated CNN for polyp segmentation during colonoscopy,” Computers in biology and medicine, vol. 137, pp. 104815, 2021.
[22]Kang J, Gwak J, “Ensemble of instance segmentation models for polyp segmentation in colonoscopy images,” IEEE Access, vol. 7, pp. 26440-26447, 2019.
[23]Jha Debesh and Smedsrud, Pia H and Riegler, Michael A and Halvorsen, Pl and de Lange, Thomas and Johansen, Dag and Johansen, Hvard D, “Kvasir-seg: A segmented polyp dataset” International Conference on Multimedia Modeling, pp. 451-462, 2020. Available online: https://datasets.simula.no/kvasir-seg/ (accessed on 28 June 2023).
[24]CVC-ClinicDB, Dataset of Endoscopic Colonoscopy Frames for Polyp Detection, 2021. Available online: https://www.kaggle.com/datasets/balraj98/cvcclinicdb (accessed on 28 June 2023).
[25]Liu C, Chen L C, Schroff F, Adam H, Hua W, Yuille A L , Li F F, “Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation,” In Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, pp. 15–20, June 2019.
[26]Prasad S, Kumar P, Sinha K P, “Grayscale to color map transformation for efficient image analysis on low processing devices. In Advances in Intelligent Informatics, pp. 9-18, 2015.
[27]Jha D, Tomar N K, Ali S, Riegler M A, Johansen H D, Johansen D, Halvorsen P, “Nanonet: Real-time polyp segmentation in video capsule endoscopy and colonoscopy,” In 2021 IEEE 34th International Symposium on Computer-Based Medical Systems (CBMS), pp. 37-43, 2021.
[28]Jha D, Ali S, Tomar N K, Johansen H D, Johansen D, Rittscher J, Halvorsen P, “Real-time polyp detection, localization and segmentation in colonoscopy using deep learning,” IEEE Access, vol. 9, pp. 40496-40510, 2021.
[29]Tomar N K, Jha D, Ali S, Johansen H D, Johansen D, Riegler M A, Halvorsen P, “DDANet: Dual decoder attention network for automatic polyp segmentation,” In Pattern Recognition ICPR International Workshops and Challenges: Virtual Event, pp. 307-314, 2021.
[30]Hatamizadeh A, Tang Y, Nath V, Yang D, Myronenko A, Landman B, Xu D, “Unetr: Transformers for 3d medical image segmentation,” In Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp. 574-584, 2022.
[31]Mahmud T, Paul B, Fattah S A, “PolypSegNet: A modified encoder-decoder architecture for automated polyp segmentation from colonoscopy images,” Computers in Biology and Medicine, vol. 128, pp. 104119, 2021.
[32]Rahman M, Murmu A, Kumar P, Moparthi N R, Namasudra S, “A novel compression-based 2D-chaotic sine map for enhancing privacy and security of biometric identification systems,” Journal of Information Security and Applications, vol. 80, pp. 103677, 2024.
[33]Long J, Shelhamer E, Darrell T, “Fully convolutional networks for semantic segmentation,” In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 3431-3440, 2015.
[34]Ronneberger O, Fischer P, Brox T, “U-net: Convolutional networks for biomedical image segmentation,” In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, pp. 234-241, 2015.
[35]Zhou Z, Siddiquee M M R, Tajbakhsh N, Liang J, “Unet++: Redesigning skip connections to exploit multiscale features in image segmentation,” IEEE transactions on medical imaging, vol. 39, no. 6, pp. 1856-1867, 2019.
[36]Ibtehaz N, Rahman M S, “MultiResUNet: Rethinking the U-Net architecture for multimodal biomedical image segmentation,” Neural networks, vol. 121, pp. 74-87, 2020.
[37]Jha D, Smedsrud P H, Riegler M A, Johansen D, De Lange T, Halvorsen P, Johansen H D, “Resunet++: An advanced architecture for medical image segmentation,” In 2019 IEEE international symposium on multimedia (ISM), pp. 225-2255, 2019.
[38]Chaurasia A, Culurciello E, “Linknet: Exploiting encoder representations for efficient semantic segmentation,” In 2017 IEEE visual communications and image processing (VCIP), pp. 1-4, 2017.
[39]Jha D, Riegler M A, Johansen D, Halvorsen P, Johansen H D, “Doubleu-net: A deep convolutional neural network for medical image segmentation,” In 2020 IEEE 33rd International symposium on computer-based medical systems (CBMS), pp. 558-56, 2020.
[40]Wang R, Chen S, Ji C, Fan J, Li Y, “Boundary-aware context neural network for medical image segmentation,” Medical Image Analysis, vol. 78, pp. 102395, 2022.
[41]Guo Y, Bernal J, J Matuszewski B, “Polyp segmentation with fully convolutional deep neural networks—extended evaluation study,” Journal of Imaging, vol. 6, no. 7, pp. 69, 2020.
[42]Mondal J J, Islam M F, Zabeen S, Manab M A, “InvoPotNet: Detecting Pothole from Images through Leveraging Lightweight Involutional Neural Network,” In 2022 25th IEEE International Conference on Computer and Information Technology (ICCIT), pp. 599-604, 2022.
[43]Ye R, Feng S, Li X, Ye Y, Zhang B, Zhu Y, Wang Y, “WDMNet: Modeling diverse variations of regional wind speed for multi-step predictions,” Neural Networks, vol. 162, pp. 147-161, 2023.
[44]Figshare, CVC-ColonDB Polyp colonoscopy image dataset [Available online: https://figshare.com/articles/figure/Polyp_DataSet_zip/21221579]
[45]Silva J, Histace A, Romain O, Dray X, Granado B, “Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer,” International Journal of Computer Assisted Radiology and Surgery, vol. 9, no. 2, pp. 283-293, 2013. DOI:10.1007/s11548-013-0926-3.
[46]Chen X, Wang X, Zhang K, Fung K M, Thai T C, Moore K, Qiu Y, “Recent advances and clinical applications of deep learning in medical image analysis,” Medical Image Analysis, vol. 79, pp. 102444, 2022.
[47]Minaee S, Boykov Y, Porikli F, Plaza A, Kehtarnavaz N, Terzopoulos D, “Image segmentation using deep learning: A survey,” IEEE Transactions on pattern analysis and machine intelligence, vol. 44, no. 7, pp. 3523-3542, 2021.
[48]Gu Z, Cheng J, Fu H, Zhou K, Hao H, Zhao Y, Liu J, “Ce-net: Context encoder network for 2d medical image segmentation,” IEEE Transactions on Medical Imaging, vol. 38, no. 10, pp. 2281-2292, 2019.