International Journal of Image, Graphics and Signal Processing (IJIGSP)
IJIGSP Vol. 11, No. 5, 8 May 2019
Cover page and Table of Contents: PDF (size: 1006KB)
Inpainting of Structural Reconstruction of Monuments Using Singular Value Decomposition Refinement of Patches
Full Text (PDF, 1006KB), PP.44-53
Views: 0 Downloads: 0
Author(s)
Index Terms
Patch Inpainting, segmentation using K means clustering, Singular Value Decomposition Refinement of Patches, Reconstruction of Monuments
Abstract
Image Inpainting of ruined historic monuments and heritage sites can help in visualizing how these may have existed in the past. An inpainted image of a monument can serve as a tool for physical reconstruction purpose. The purpose of the proposed method is to fill cracks and gaps of selected damaged regions in heritage monuments by exploiting the statistical properties of foreground and background along with the spatial location of the damage in the image of the monuments. The patch based image inpainting algorithm is improved by segmenting the image using K means clustering to search the candidate patches in relevant source region only. Segmentation improves patch searching in terms of both quality and time. The priority of the patch to fill is decided based on the standard deviation of the patch around destination pixel. Kn similar patches are selected from the source region based on minimum value of sum squared distance. The selected patches are refined using an efficient patch refinement scheme using higher order singular value decomposition to capture underlying pattern among the candidate source patches. The threshold for refinement is selected by using minimum and maximum value of standard deviation of the target patch. This eliminates random variation and unwanted artifacts. Experimental results carried on a large number of natural images and comparisons with well-known existing methods demonstrate the efficacy and superiority of the proposed method.
Cite This Paper
Anupama S Awati, Meenakshi. R. Patil, "Inpainting of Structural Reconstruction of Monuments Using Singular Value Decomposition Refinement of Patches", International Journal of Image, Graphics and Signal Processing(IJIGSP), Vol.11, No.5, pp. 44-53, 2019. DOI: 10.5815/ijigsp.2019.05.05
Reference
[1]C Guillemot, O Le Meur, “Image inpainting: Overview and recent advances”, IEEE signal processing magazine, 2014.
[2]A. Criminisi, P. Perez, and K. Toyama, “Region filling and object removal by exemplar-based image inpainting,” IEEE Trans. Image. Process., vol. 13, no. 9, pp. 1200–1212, Sep. 2004.
[3]Fan Qian, Zhang Lifeng, Hu Xuelong, “Exemplar-based image inpainting algorithm using adaptive sample and candidate patch system”, 2015 IEEE 12th International Conference on Electronic Measurement & Instruments ICEMI'2015.
[4]Olivier Le Meur, Josselin Gautier Christine Guillemot, “Examplar-Based Inpainting Based On Local Geometry”, Image Processing (ICIP), 2011 ieeexplore.ieee.org.
[5]R. Martinez-Noriega, A. Roumy G. Blanchard, “Exemplar·Based Image Inpainting: Fast Priority And Coherent Nearest Neighbor Search”, 2012 IEEE International Workshop On Machine Learning For Signal Processing, SEPT. 23-26, 2012
[6]LIU Ying, LIU Chan-juan, ZOU Hai-lin, ZHOU Shu-sen, SHEN Qian, “A Novel Exemplar-based Image Inpainting Algorithm”, International Conference on Intelligent Networking and Collaborative Systems IEEE computer society.
[7]Kaushik kumar R. Patel, Lalit Jain, “A Novel Approach to Exemplar Based Image Inpainting”, IEEE Technology for Humanity.
[8]Ding Ding,, Sundaresh Ram, Jeffrey J. Rodriguez “Perceptually aware image inpainting”, Pattern Recognition journal www.elsevier.com.
[9]Y Qin, F Wang, “ A curvature constraint Exemplar-based image inpainting”, Image Analysis and Signal Processing (IASP),2010 ieeexplore.ieee.org.
[10]Yunqiang Liu and Vicent Caselles, “Exemplar-Based Image Inpainting Using Multiscale Graph Cuts”, IEEE Transactions On Image Processing, Vol. 22, No. 5, May 2013.
[11]Veepin Kumar, Jayanta Mukherjee, and Shyamal Kumar Das Mandal “Image Inpainting Through Metric Labeling via Guided Patch Mixing”, IEEE Transactions On Image Processing, Vol. 25, No. 11, November 2016.
[12]Qiang Guo , Shanshan Gao, Xiaofeng Zhang, Yilong Yin, and Caiming Zhang “Patch-Based Image Inpainting via Two-Stage Low Rank Approximation”, IEEE Transactions On Visualization And Computer Graphics, Vol. 24, No. 6, June 2018.
[13]Guibo Luo, Yuesheng Zhu,, and Biao Guo Fast “MRF-Based Hole Filling for View Synthesis”, IEEE Signal Processing Letters, Vol. 25, No. 1, January 2018
[14]Yi Ren, Yaniv Romano, and Michael Elad “Example-Based Image Synthesis via Randomized Patch-Matching”, IEEE Transactions On Image Processing, Vol. 27, No. 1, January 2018.
[15]Jiaying Liu, Shuai Yang , Yuming Fang and Zongming Guo “Structure-Guided Image Inpainting Using Homography Transformation”, IEEE Transactions On Multimedia, Vol. 20, No. 12, December 2018.
[16]Ding Ding , Sundaresh Ram and Jeffrey J. Rodríguez “Image Inpainting Using Nonlocal Texture Matching and Nonlinear Filtering”, IEEE Transactions On Image Processing, Vol. 28, No. 4, April 2019.
[17]Sarawut Akinori Nishihara, “Exemplar-Based Image Inpainting With Patch Shifting Scheme”.
[18]Deng L-J, Huang T-Z, Zhao X-L (2015) “Exemplar-Based Image Inpainting Using a Modified Priority Definition”. PLoS ONE 10(10): e0141199. doi:10.1371/journal.pone.0141199
[19]Song Wang Hong Li Xia Zhu Ping Li, “An Evaluation Index Based on Parameter Weight for Image Inpainting Quality”2008 IEEE computer society.
[20]Mrinmoy Ghorai, Sekhar Mandal, Bhabatosh Chanda A Two-Step Image Inpainting Algorithm Using Tensor SVD Published in ACCV Workshops 2014 DOI:10.1007/978-3-319-16631-5_5.
[21]M. G. Padalkar and M. V. Joshi, "Auto-inpainting Heritage Scenes: A Complete Framework for Detecting and Infilling Cracks in Images and Videos with Quantitative Assessment," in Machine Vision and Applications (MVA),vol. 26, no. 2–3, 317–337, March 2015.