International Journal of Image, Graphics and Signal Processing (IJIGSP)
IJIGSP Vol. 16, No. 4, 8 Aug. 2024
Cover page and Table of Contents: PDF (size: 773KB)
Seamless Panoramic Image Stitching Based on Invariant Feature Detector and Image Blending
PDF (773KB), PP.30-41
Views: 0 Downloads: 0
Author(s)
Megha V.
1,*
Rajkumar K. K.
1
Index Terms
Image stitching, key points, feature extraction, feature matching, SIFT, KNN, Blending
Abstract
Image stitching is the method of creating a composite image from several images of the same scene. This paper addresses the issues of generating a seamless panoramic image from a series of photographs of the same scene by varying scale, orientation and illumination. A feature-based approach is proposed in this paper. Scale Invariant Feature Transform (SIFT) is used to detect key points in the image. SIFT is both a feature detector and descriptor. The common region between different images is identified by comparing the feature descriptors of each image. Brute-Force matcher with KNN algorithm is used for feature matching. The outliers in the matching features are eliminated by Random Sample Consensus (RANSAC) algorithm. To create seamless image, alpha blending operation is applied. Experiments are conducted on UDISD (Unsupervised Deep Image Stitching Data set). The overall performance of the proposed stitching method is evaluated based on metrics such as PSNR, SSIM, RMSE, MSE and UIQI, and the proposed stitching algorithm yields good result with seamless stitched image.
Cite This Paper
Megha V. , Rajkumar K. K. , "Seamless Panoramic Image Stitching Based on Invariant Feature Detector and Image Blending", International Journal of Image, Graphics and Signal Processing(IJIGSP), Vol.16, No.4, pp. 30-41, 2024. DOI:10.5815/ijigsp.2024.04.03
Reference
[1]K. Shashank, N. SivaChaitanya, G. Manikanta, C. N. V. Balaji, and V. V. S. Murthy, “A Survey and Review Over Image Alignment and Stitching Methods,” vol. 5, p. 3, 2014
[2]Y. Deng and T. Zhang, “Generating panorama photos,” Orlando, FL, Nov. 2003, pp. 270–279. doi: 10.1117/12.513119.D. Ghosh and N. Kaabouch, “A survey on image mosaicing techniques,” Journal of Visual Communication and Image Representation, vol. 34, pp. 1–11, Jan. 2016, doi: 10.1016/j.jvcir.2015.10.014.
[3]E. Adel, M. Elmogy, and H. Elbakry, “Image Stitching based on Feature Extraction Techniques: A Survey,” IJCA, vol. 99, no. 6, pp. 1–8, Aug. 2014, doi: 10.5120/17374-7818.
[4]C. Arth, M. Klopschitz, G. Reitmayr, and D. Schmalstieg, “Real-Time Self-Localization from Panoramic Images on Mobile Devices,” p. 11.
[5]Y. A. Y. Al-Najjar and D. D. C. Soong, “Comparison of Image Quality Assessment; PSNR, HVS, SSIM, UIQI,” vol. 3, no. 8, p. 5, 2012.
[6]P. M. Jain and V. K. Shandliya, “A Review Paper on Various Approaches for Image Mosaicing,” p. 4.
[7]R. Szeliski, “Image Alignment and Stitching: A Tutorial,” FNT in Computer Graphics and Vision, vol. 2, no. 1, pp. 1–104, 2007, doi: 10.1561/0600000009.
[8]Y. Douini, J. Riffi, M. A. Mahraz, and H. Tairi, “Solving sub-pixel image registration problems using phase correlation and Lucas- Kanade optical flow method,” p. 5.
[9]M. V and R. K K, “A Comparative Study on Different Image Stitching Techniques,” IJETT, vol. 70, no. 4, pp. 44–58, Apr. 2022, doi: 10.14445/22315381/IJETT-V70I4P205.
[10]M. V and R. K K, “Panoramic Image Stitching Using Cross Correlation and Phase Correlation Methods,” IJCS, vol. 8, no. 2, pp. 2500–2516, Sep. 2020.
[11]R. Prados, R. Garcia, and L. Neumann, Image Blending Techniques and their Application in Underwater Mosaicing. Cham: Springer International Publishing, 2014. doi: 10.1007/978-3-319-05558-9.
[12]M. Wang, S. Niu, and X. Yang, “A novel panoramic image stitching algorithm based on ORB,” in 2017 International Conference on Applied System Innovation (ICASI), Sapporo, Japan, May 2017, pp. 818–821. doi: 10.1109/ICASI.2017.7988559.
[13]K. P. Win and Y. Kitjaidure, “Biomedical Images Stitching using ORB Feature Based Approach,” in 2018 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), Bangkok, Oct. 2018, pp. 221–225. doi: 10.1109/ICIIBMS.2018.8549931.
[14]W. Zhang, X. Li, J. Yu, M. Kumar, and Y. Mao, “Remote sensing image mosaic technology based on SURF algorithm in agriculture,” J Image Video Proc., vol. 2018, no. 1, p. 85, Dec. 2018, doi: 10.1186/s13640-018-0323-5.
[15]T. Zhang, R. Zhao, and Z. Chen, “Application of Migration Image Registration Algorithm Based on Improved SURF in Remote Sensing Image Mosaic,” IEEE Access, vol. 8, pp. 163637–163645, 2020, doi: 10.1109/ACCESS.2020.3020808.
[16]Y. Yuan, F. Fang, and G. Zhang, “Superpixel-Based Seamless Image Stitching for UAV Images,” IEEE Trans. Geosci. Remote Sensing, vol. 59, no. 2, pp. 1565–1576, Feb. 2021, doi: 10.1109/TGRS.2020.2999404.
[17]D. G. Lowe, “Distinctive Image Features from Scale-Invariant Keypoints,” International Journal of Computer Vision, vol. 60, no. 2, pp. 91–110, Nov. 2004, doi: 10.1023/B:VISI.0000029664.99615.94.
[18]R. M. Akhyar and H. Tjandrasa, “Image Stitching Development By Combining SIFT Detector And SURF Descriptor For Aerial View Images,” in 2019 12th International Conference on Information & Communication Technology and System (ICTS), Surabaya, Indonesia, Jul. 2019, pp. 209–214. doi: 10.1109/ICTS.2019.8850941.
[19]M. Chen, R. Nian, B. He, S. Qiu, X. Liu, and T. Yan, “Underwater image stitching based on SIFT and wavelet fusion,” in OCEANS 2015 - Genova, Genova, Italy, May 2015, pp. 1–4. doi: 10.1109/OCEANS-Genova.2015.7271744.
[20]A. Jakubovic and J. Velagic, “Image Feature Matching and Object Detection Using Brute-Force Matchers,” in 2018 International Symposium ELMAR, Zadar, Sep. 2018, pp. 83–86. doi: 10.23919/ELMAR.2018.8534641.
[21]M. A. Fischler and R. C. Bolles, “Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography,” in Readings in Computer Vision, Elsevier, 1987, pp. 726–740. doi: 10.1016/B978-0-08-051581-6.50070-2.
[22]N. Arad and D. Reisfeld, “Image WarpingRaUdsiianlgFfuenwctAionncshor Points and,” p. 12, 1994.
[23]Q. Fu and H. Wang, “A fast image stitching algorithm based on SURF,” in 2017 IEEE/CIC International Conference on Communications in China (ICCC), Qingdao, Oct. 2017, pp. 1–4. doi: 10.1109/ICCChina.2017.8330425.
[24]E. Adel, M. Elmogy, and H. Elbakry, “Real time image mosaicing system based on feature extraction techniques,” in 2014 9th International Conference on Computer Engineering & Systems (ICCES), Cairo, Egypt, Dec. 2014, pp. 339–345. doi: 10.1109/ICCES.2014.7030983.
[25]A. Tahtirvanci and A. Durdu, “Performance Analysis of Image Mosaicing Methods for Unmanned Aerial Vehicles,” in 2018 10th International Conference on Electronics, Computers and Artificial Intelligence (ECAI), Iasi, Romania, Jun. 2018, pp. 1–7. doi: 10.1109/ECAI.2018.8679007.
[26]Zhou Wang and A. C. Bovik, “A universal image quality index,” IEEE Signal Process. Lett., vol. 9, no. 3, pp. 81–84, Mar. 2002, doi: 10.1109/97.995823.
[27]W. Wan et al., “A PERFORMANCE COMPARISON OF FEATURE DETECTORSFOR PLANETARY ROVER MAPPING AND LOCALIZATION,” Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., vol. XLII-3/W1, pp. 149–154, Jul. 2017, doi: 10.5194/isprs-archives-XLII-3-W1-149-2017.