International Journal of Image, Graphics and Signal Processing (IJIGSP)
IJIGSP Vol. 9, No. 10, 8 Oct. 2017
Cover page and Table of Contents: PDF (size: 616KB)
Robust Assistive Reading Framework for Visually Challenged
Full Text (PDF, 616KB), PP.29-37
Views: 0 Downloads: 0
Author(s)
Index Terms
Assistive framework, Visually Challenged, Optical Character Recognition, Text to Speech and deblurring
Abstract
The Main objective of this assistive framework is to communicate the textual Information in the image captured by the Visually Challenged person as Speech, So that the Visually Challenged person can acquire knowledge about the surrounding. This framework can help Visually Challenged person to read books, magazine, warnings, instructions and various displays as well by taking their image along with the surrounding. Then the Optical Character Recognition (OCR) extracts and recognizes the text in the image and generates the text file. This text file is further converted to Speech with the help of Text to Speech (TTS) Synthesis. The inherent problem with the previous approach was if the acquired image is affected with the issues of different lighting conditions, noise and issue of Skew and Blur, as the image is captured by Visually Challenged person. Then the overall accuracy of the system was at stake due to inefficient OCR leads to improper Speech output of TTS Synthesis. In this paper we have introduced two more processes that are deblurring using Blind Deconvolution method and Pre-processing operation to remove the effect of noise and blur. Thus it prepares the image for efficient result of the framework for Visually Challenged. The proposed approach is implemented in Matlab with the image captured manually and taken from the internet and the result along with the OCR text file and corresponding output Speech shows that our framework is better than the previous framework.
Cite This Paper
Avinash Verma, Deepak Kumar Singh," Robust Assistive Reading Framework for Visually Challenged", International Journal of Image, Graphics and Signal Processing(IJIGSP), Vol.9, No.10, pp. 29-37, 2017. DOI: 10.5815/ijigsp.2017.10.04
Reference
[1]Marion A.Hersh, Michael A.Johnson “Assistive technology for Visually Impaired and Blind people” Book by Springer ISBN 978-1-84628-866.
[2]C. Gonzalez Richard E. Woods “Digital Image Processing” Book Third Edition Rafael Interactive Pearson International Edition prepared by Pearson Education PEARSON Prentice Hall.
[3]Jian Liang, Daniel DeManthon “Geometric rectification of Camera-Captured Document Image” IEEE Transaction on Pattern Analysis and Machine Intelligence Vol 30 No 4 April 2008.
[4]U. Pal, B.B. Chaudhuri "Indian script character recognition: a survey" Pattern Recognition 37 (2004) 1887 – 1899 published by ELSEVIER
[5]J.Amudha, N.Pradeepa, R.Sudhakar "A Survey on Digital Image Restoration" ELSEVIER Procedia Engineering, Volume 38, 2012, Pages 2378-2382.
[6]Ratnakar Dash “Parameter Estimation for Image Restoration” PhD thsis NIT Rourkela, Orrisa,India March 2012.
[7]Rainer Lienhart, Member, IEEE, and Axel Wernicke "Localizing and Segmenting Text in Images and Videos" IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 12, NO. 4, APRIL 2002.
[8]Honggang Zhang,KailiZhao,Yi-ZheSong,Jun Guo " A Text extraction from natural scene image:A survey" Neurocomputing 122 (2013) ELSEVIER.
[9]Avinash Verma, Deepak Kumar Singh “ Text Deblurring Using OCR Word Confidence”, International Journel of Image, Graphics and Signal Processing (IJIGSP), Vol.9, No.1, pp. 33-40, 2017, DOI :10.5815/ijigsp.2017.01.05.
[10]Kaveri Kamble, Ramesh Kagalkar "A Review: Translation of Text to Speech Conversion for Hindi Language" International Journal of Science and Research (IJSR) Volume 3 Issue 11, November 2014
[11]Suhas R. Mache,Manasi R. Baheti,C. Namrata Mahender "Review on Text-To-Speech Synthesizer" International Journal of Advanced Research in Computer and Communication Engineering Vol. 4, Issue 8, August 2015.
[12]Itunuoluwa Isewon,Jelili Oyelade,Olufunke Oladipupo "Design and Implementation of Text To Speech Conversion for Visually Impaired People" International Journal of Applied Information Systems Foundation of Computer Science FCS, New York, USA Volume 7– No. 2, April 2014
[13]Avinash Verma, Deepak Kumar Singh, Nitesh Kumar Singh “ Review on Assistive Reading framework for Visually Challenged” accepted for publication by International Conference on Computational Intelligence in Data Mining (ICCIDM-2016) in the AISC Series, Springer.
[14]Akbar S. Shaik, G Hossain “Desgin and Development and performance Evaluation of Reconfigured Mobile Android Phone for People Who are blind or Visually Impaired” In Proceedings of the 28th ACM International Conference on Design of Communication,,New York, NY, USA, 2010. ACM. October 2010.
[15]Akshay Sharma, Abhishek Srivastava, Adhar Vashishth “ An Assistive Reading System for Visually Impaired using OCR and TTS” International Journal of Computer Applications, Vol 95, No. 2 June 2014.
[16]Chucai Yi, Yingli Tian and Aries Arditi “Portable Camera-Based Assistive Text and Product Label Reading from Hand Held Objects for Blind Persons” IEEE/ASME Transaction on Mechatronics.
[17]Patrick E.Lanigan, Aaron M. Paulos, Andrew W. Williams, Dan Rossi and Priya Narasimhan “Trinetra: Assistive Technology for Grocery Shopping for the Blind” Published by Cylab in 2006.
[18]Bindu Philips and R.D. Sudhaker Samuel “ Human Machine Interface – A smart OCR for the visually challenged”, International Journal of Recent Trends in Engineering, Vol 2, No. 3 November 2009.
[19]Roberto Netoa, Nuno Fonsecaa "Camera Reading For Blind People" HCIST 2014 International Conference on Health and Social Care Information Systems and Technologies, Procedia Technology 16 ( 2014 ) 1200 – 1209 published by ELSEVIER.
[20]Ray Smith Google Inc. theraysmith@gmail.com “An Overview of the Tesseract OCR Engine” Google Inc OSCON 2007.
[21]Shamik Tiwari, V. P. Shukla, and A. K. Singh “Review of Motion Blur Estimation Techniques” Journal of Image and Graphics Vol. 1, No. 4, December 2013.
[22]Kishore R. Bhagat,Puran Gour "Novel Approach to Estimate Motion Blur Kernel Parameters and Comparative Study of Restoration Techniques"International Journal of Computer Applications (0975 – 8887) Volume 72– No.17, June 2013.
[23]Lu Fang, Haifeng Liu, Feng Wu, Xiaoyan Sun, Houqiang Li "Separable Kernel for Image Deblurring" 2014 IEEE Conference on Computer Vision and Pattern Recognition Pages: 2885 - 2892, DOI: 10.1109/CVPR.2014.369.
[24]Jing Wang, Ke Lu, Qian Wang, and Jie Jia "Kernel Optimization for Blind Motion Deblurring with Image Edge Prior" Hindawi Publishing Corporation Mathematical Problems in Engineering Volume 2012, Article ID 639824, 10 pages doi:10.1155/2012/639824.
[25]Long Mai,Feng Liu "Kernel fusion for better image deblurring" 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Pages: 371 - 380, DOI: 10.1109/CVPR.2015.7298634.
[26]Taeg Sang Cho,Sylvain Paris,Berthold K. P. Horn,William T. Freeman “Blur Kernel Estimation using the Radon Transform” Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on June 2011.
[27]Zohair Al-Ameen,Ghazali Bin Sulong,Md. Gapar Md. Johar “Computer Forensics and Image Deblurring: An Inclusive Investigation” IJMECS Vol.5, No. 11, November 2013 PP.42-48, DOI: 10.5815/ijmecs.2013.11.06.