International Journal of Image, Graphics and Signal Processing (IJIGSP)
IJIGSP Vol. 15, No. 2, 8 Apr. 2023
Cover page and Table of Contents: PDF (size: 599KB)
A Novel Technique for Image Retrieval based on Concatenated Features Extracted from Big Dataset Pre-Trained CNNs
Full Text (PDF, 599KB), PP.1-12
Views: 0 Downloads: 0
Author(s)
Index Terms
Content Based Image Retrieval, Big Transfer Network, Pre-trained Convolutional Neural Network, ImageNet-21K, COREL-100, CALTECH-101, FLOWER-17, COIL-100 datasets
Abstract
Accessing semantically relevant data from a database is not only essential in commercial applications but also in medical imaging diagnosis. Representation of the query image by its features and subsequently the dataset are the key factors in Content Based Image Retrieval (CBIR). Texture, shape and color are commonly used features for this purpose. Features extracted from the pre-trained Convolutional Neural Networks (CNNs) are used to improve the performance of CBIR methods. In this work, we explore a recent state of the art big dataset pre-trained CNNs which are known as Big Transfer Networks. Features extracted from Big Transfer Network have higher discriminative power compared to features of many other pre-trained CNNs. The idea behind the proposed work is to demonstrate the effectiveness of using features of big transfer networks for image retrieval. Further, features extracted from big transfer networks are concatenated to improve the performance of the proposed method. Feature diversity supplemented with network diversity should ensure good discriminative power for image retrieval. This idea is supported by performing simulations on four datasets with varying sizes in terms of number of images and classes. As feature size increases with the concatenation, we applied a dimensionality reduction algorithm i.e., Principal Component Analysis. Several distance metrics are explored in this work. By properly choosing the pre-trained CNNs and distance metric, it is possible to achieve higher mean average precisions. ImageNet-21K pre-trained CNN and Instagram pre-trained CNN are chosen in this work. Further, a pre-trained network trained on Imagenet-21K dataset is superior compared to the networks trained on ImageNet-1K dataset as there are more classes and presence of wide variety of images. This is demonstrated by applying our algorithm on four datasets i.e., COREL-100, CALTECH-101, FLOWER-17 and COIL-100. Simulations are presented for various precisions (scopes), and distance metrics. Results are compared with the existing algorithms and superiority of the proposed method in terms of mean Average Precision is shown.
Cite This Paper
Chandra Mohan Bhuma, Ramanjaneyulu Kongara, "A Novel Technique for Image Retrieval based on Concatenated Features Extracted from Big Dataset Pre-Trained CNNs", International Journal of Image, Graphics and Signal Processing(IJIGSP), Vol.15, No.2, pp. 1-12, 2023. DOI:10.5815/ijigsp.2023.02.01
Reference
[1]Liu Y, Zhang D, Lu G, Ma WY. A survey of content-based image retrieval with high-level semantics. Pattern recognition. 2007 Jan 1; 40(1):262-82.
[2]Manjunath BS, Ohm JR, Vasudevan VV, Yamada A. Color and texture descriptors. IEEE Transactions on circuits and systems for video technology. 2001 Jun; 11(6):703-15.
[3]Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M, Berg AC. Imagenet large scale visual recognition challenge. International journal of computer vision. 2015 Dec; 115(3):211-52.
[4]Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L. Imagenet: A large-scale hierarchical image database. In2009 IEEE conference on computer vision and pattern recognition 2009 Jun 20 (pp. 248-255). Ieee.
[5]Sun C, Shrivastava A, Singh S, Gupta A. Revisiting unreasonable effectiveness of data in deep learning era. In Proceedings of the IEEE international conference on computer vision 2017 (pp. 843-852). https://ai.googleblog.com/2017/07/revisiting-unreasonable-effectiveness.html
[6]Kolesnikov A, Beyer L, Zhai X, Puigcerver J, Yung J, Gelly S, Houlsby N. Big transfer (bit): General visual representation learning. InEuropean conference on computer vision 2020 Aug 23 (pp. 491-507). Springer, Cham. https://arxiv.org/pdf/1912.11370.pdf
[7]Mahajan D, Girshick R, Ramanathan V, He K, Paluri M, Li Y, Bharambe A, Van Der Maaten L. Exploring the limits of weakly supervised pretraining. In Proceedings of the European conference on computer vision (ECCV) 2018 (pp. 181-196). arXiv. 1805.00932.
[8]Pearson K. LIII. On lines and planes of closest fit to systems of points in space. The London, Edinburgh, and Dublin philosophical magazine and journal of science. 1901 Nov 1; 2(11):559-72.
[9]Niblack CW, Barber R, Equitz W, Flickner MD, Glasman EH, Petkovic D, Yanker P, Faloutsos C, Taubin G. QBIC project: querying images by content, using color, texture, and shape. InStorage and retrieval for image and video databases 1993 Apr 14 (Vol. 1908, pp. 173-187). Spie.
[10]Ashraf R, Bashir K, Irtaza A, Mahmood MT. Content based image retrieval using embedded neural networks with bandletized regions. Entropy. 2015 May 29;17(6):3552-80.
[11]Khokhar S, Verma S. Content based image retrieval with multi-feature classification by back-propagation neural network. Int. J. Comput. Appl. Technol. Res. 2017 Jul;6:278-84.
[12]Sharif U, Mehmood Z, Mahmood T, Javid MA, Rehman A, Saba T. Scene analysis and search using local features and support vector machine for effective content-based image retrieval. Artificial Intelligence Review. 2019 Aug; 52(2):901-25.
[13]Ahmed KT, Naqvi SA, Rehman A, Saba T. Convolution, approximation and spatial information based object and color signatures for content based image retrieval. In2019 International Conference on Computer and Information Sciences (ICCIS) 2019 Apr 3 (pp. 1-6). IEEE.
[14]Maji S, Bose S. CBIR using features derived by deep learning. ACM/IMS Transactions on Data Science (TDS). 2021 Aug 31; 2(3):1-24.
[15]Bose S, Pal A, Chakrabarti D, Mukherjee T. Improved content-based image retrieval via discriminant analysis. International Journal of Machine Learning and Computing. 2017 Jun; 7(3):44-48
[16]Rana SP, Dey M, Siarry P. Boosting content based image retrieval performance through integration of parametric & nonparametric approaches. Journal of Visual Communication and Image Representation. 2019 Jan 1; 58:205-19.
[17]Fadaei S, Amirfattahi R, Ahmadzadeh MR. New content‐based image retrieval system based on optimised integration of DCD, wavelet and curvelet features. IET Image Processing. 2017 Feb;11(2):89-98.
[18]Cui C, Lin P, Nie X, Yin Y, Zhu Q. Hybrid textual-visual relevance learning for content-based image retrieval. Journal of Visual Communication and Image Representation. 2017 Oct 1; 48:367-74.
[19]Dhingra S, Bansal P. A novel & efficient fusion based image retrieval model for speedy image recovery. EAI Endorsed Transactions on Scalable Information Systems. 2020; 7(27).
[20]Putri RD, Prabawa HW, Wihardi Y. Color and texture features extraction on content-based image retrieval. In2017 3rd International Conference on Science in Information Technology (ICSITech) 2017 Oct 25 (pp. 711-715). IEEE.
[21]Kumar V, Tripathi V, Pant B. Content based fine-grained image retrieval using convolutional neural network. In2020 7th International Conference on Signal Processing and Integrated Networks (SPIN) 2020 Feb 27 (pp. 1120-1125). IEEE.
[22]Kumar A, Choudhary S, Khokhar VS, Meena V, Chattopadhyay C. Automatic feature weight determination using indexing and pseudo-relevance feedback for multi-feature content-based image retrieval. arXiv preprint arXiv:1812.04215. 2018 Dec 11.
[23] Obulesu A, Kumar VV, Sumalatha L., “Content based image retrieval using multi motif co-occurrence matrix”. International Journal of Image, Graphics and Signal Processing. 2018 Apr 1; 10(4):59-72.
[24] Islam SM, Debnath R. “A comparative evaluation of feature extraction and similarity measurement methods for content-based image retrieval”. International Journal of Image, Graphics and Signal Processing. 2020; 12(6):19-32.
[25] Arora N, Ashok A, Tiwari S., "Efficient Image Retrieval through Hybrid Feature Set and Neural Network". International Journal of Image, Graphics & Signal Processing. 2019 Jan 1; 11(1):44-53.
[26] Pandian AA, Balasubramanian R., "Analysis on Shape Image Retrieval Using DNN and ELM Classifiers for MRI Brain Tumor Images". International Journal of Information Engineering and Electronic Business. 2016 Jul 1; 8(4):63-72.