Anand G Buddhikot; Nitin. M. Kulkarni; Arvind.D. Shaligram

Hand Gesture Interface based on Skin Detection Technique for Automotive Infotainment System

Full Text (PDF, 766KB), PP.10-24

Views: 0 Downloads: 0

Author(s)

Anand G Buddhikot ^1,* Nitin. M. Kulkarni ² Arvind.D. Shaligram ³

1. Kaveri College of Arts, Science and Commerce, Pune, India

2. Fergusson College , Pune

3. Savitribai Phule Pune University, Pune

* Corresponding author.

DOI: https://doi.org/10.5815/ijigsp.2018.02.02

Received: 6 Oct. 2017 / Revised: 26 Oct. 2017 / Accepted: 17 Nov. 2017 / Published: 8 Feb. 2018

Index Terms

HMI, Infotainment system, Skin detection, gesture, Hi-Vi, color space

Abstract

The infotainment systems are acquiring wide popularity in automotive domain. These systems are manually operated and require physical contact for interaction. In the present scenario the consumers are demanding a smart phone like experience from the vehicle’s console unit. Thus, there is a wide scope for enhancing the mode of interaction and introducing a touch less interface system. The gesture interface approach is a new possibility in this domain. In this method the skin detection plays an important role in segmenting hand region. There are various approaches for hand detection based on skin region identification. The fundamental challenge in skin detection lies in various factors such as illumination, background, camera characteristics, and ethnicity. The gesture detection in automotive environment is further challenging task due to significant impact of wide variation in light, continuous changing background and hindrance caused by vehicle movement. In the present work, design of hand gesture interface for rear seat passenger is discussed. The interface is developed to interact with media player application of infotainment system based on efficient skin detection technique. The objectives of work include study of various skin color modeling, analysis of combination of color spaces, study of hand feature extraction and recognition techniques, design of lab setup for experimentation, implementing gesture interface to access media player application of an infotainment system. The developed prototype lab set up is used for analyzing the skin classifiers and designing a Hi-Vi skin classifier. Further, a user friendly interface is developed using Hi-Vi algorithm with multimode interface features. The evaluation of developed system shows high TPR and low FPR.

Cite This Paper

Anand G Buddhikot, Nitin. M. Kulkarni, Arvind.D. Shaligram," Hand Gesture Interface based on Skin Detection Technique for Automotive Infotainment System", International Journal of Image, Graphics and Signal Processing(IJIGSP), Vol.10, No.2, pp. 10-24, 2018. DOI: 10.5815/ijigsp.2018.02.02

Reference

[1]Sumit Dev, “Trends in Automotive Infotainment”, EDN February 2012, www.ednasia.com, pp8-9.

[2]T.V.U. Kiran Kumar, B. Karthik and E. Bharath Kumaran, “Implementation of a Can-Based Digital Driving System for a Vehicle”, Middle-East Journal of Scientific Research 13 (12): 1564-1569, 2013, ISSN 1990-9233, © IDOSI Publications, 2013, DOI: 10.5829/Idosi.mejsr. 2013.13.12.1237.

[3]Dagmar Kern, Albrecht Schmidt, “Design Space for Driver-Based Automotive User Interface”, Proc. Of first international conference on Automotive user interfaces and interactive vehicular application (Automotive UI 2009) sep. 21-22 2009 Essen, Germany.

[4]Eshed Ohn-Bar, Student Member, IEEE, and Mohan Manubhai Trivedi, Fellow, IEEE, “Hand Gesture Recognition in Real Time for Automotive Interfaces: A Multimodal Vision-Based Approach and Evaluations”, IEEE Transactions on Intelligent Transportation Systems, Vol.15, NO. 6, December 2014.

[5]Minyoung Kim1, Jae-Hyun Nam2 & Jong-Wook Jang, “ Implementation of Smart Car Infotainment System including Black Box and Self-diagnosis Function”, International Journal of Software Engineering and Its Applications, Vol.8, No.1 (2014), pp.267-274.

[6]Robert Neßelrath, Michael Feld, “Towards a Cognitive Load Ready Multimodal Dialogue System for In-Vehicle Human-Machine Interaction”, Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Automotive UI ‚13), October 28–30, 2013, Eindhoven, The Netherlands.

[7]Anand G. Buddhikot, Nitin M. Kulkarni, Arvind D. Shaligram, “Designing Gesture Interface for Automotive Environment”, International Journal Of Innovative Research In Advanced Engineering (IJIRAE) Issue 06, Volume 3 (June 2016), ISSN:2349-2763, pp148-151.

[8]Victoria Fang, Lucas Ainsworth, “Designing & Rapid Prototyping a Gesture-Enabled Steering Wheel”, Adjunct Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '12), October 17–19, 2012, Portsmouth.

[9]Simon Nestler, Marcus Tönnis, and Gudrun Klinker, “Common Interaction Schemes for In-Vehicle User-Interfaces”, J.A. Jacko (Ed.): Human-Computer Interaction, Part III, HCII 2009, LNCS 5612, pp. 159–168, 2009. © Springer-Verlag Berlin Heidelberg 2009.

[10]Ronald Ecker1 Verena Broy1 Katja Hertzschuch1 Andreas Butz, “Visual Cues supporting Direct Touch Gesture Interaction with In-Vehicle Information Systems”, Proceedings of the Second International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI 2010), November 11-12, 2010, Pittsburgh, Pennsylvania, USA.

[11]A. Riener, A. Ferscha, F. Bachmair, P. Hagmüller, A. Lemme, D. Muttenthaler, “Standardization of the In-Car Gesture Interaction Space”, Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ‚13), October 28–30, 2013, Eindhoven, The Netherlands.

[12]Ian R. Buck, “Infotainment Interface Design for Automobiles”, Scholarly Horizons: University of Minnesota, Morris Undergraduate Journal, Vol. 2 [2015], Iss. 2, Art. 1, PP 1-6

[13]Shinko Y.Cheng and Mohan Trivedi, “Real –time Vision based Infotainment user Determination for Driver Assistance”, 2008 IEEE Intelligent Vehicles Symposium,978-4244-2569-3/08@2008 IEEE

[14]Angela Mahr, Christoph Endres, Tanja Schneeberger, Christian Muller, “Determining Human –Centered Parameters of Ergonomic Micro-Gesture Interaction for Drivers Using the Theater Approach’, AutomotiveUI’-11 Proceedings, November 29-December-2 2011,

[15]Anand G. Buddhikot, Nitin M. Kulkarni, Arvind D. Shaligram, “Design of Multimodal Interface for In-vehicle Infotainment System”, International Journal of Automotive Electronics, ISSN: 2051-7832, Vol.28, Issue.1, © RECENT SCIENCE PUBLICATIONS ARCHIVES |December 2016

[16]Jobin Francis, Anoop B K, “Significance of Hand Gesture Recognition Systems in Vehicular Automation- A survey”, International Journal of Computer Applications (0975 – 8887), Volume 99– No.7, August 2014.

[17]Santosh Naik,Abhishek.H.R, Ashwal K.N, Balasubramanya S.P, “ A study of Automotive Human Vehicle Integration using Gesture Recognition Technology”, IJMCIS, Vol-1 N0.2 Nov-12,ISSN 23202610.

[18]Swapnil D. Badgujar1, Gourab Talukdar2, Omkar Gondhalekar3, Mrs. S.Y. Kulkarni4, “ Hand Gesture Recognition system”, International Journal of Scientific and Research Publications, Volume 4, Issue 2, February 2014 1 ISSN 2250-3153.

[19]Siddharth S. Rautaray · Anupam Agrawal, “Vision based hand gesture recognition for human computer interaction: a survey”, © Springer Science+Business Media Dordrecht 2012, Artif Intell Rev DOI 10.1007/s10462-012-9356-9.

[20]P. Kakumanu, S. Makrogiannis, N. Bourbakis, “A survey of skin-color modeling and detection methods”, Pattern Recognition 40 (2007) 1106 – 1122, doi:10.1016/j.patcog.2006.06.010.

[21]Chen-Chiung Hsieh1*, Dung-Hua Liou1 and Wei-Ru Lai2, “Enhanced Face-Based Adaptive Skin Color Model”, Journal of Applied Science and Engineering, Vol. 15, No. 2, pp. 167_176 (2012)

[22]Włodzimierz Kasprzak , Artur Wilkowski, Karol Czapnik , “Hand Gesture Recognition Based on Free–Form Contours and Probabilistic Inference”, Int. J. Appl. Math. Comput. Sci., 2012, Vol. 22, No. 2, 437–448, DOI: 10.2478/v10006-012-0033-6.

[23]Ahmad Y Dawod, Md Jan Nordin, Junaidi Abdullah, “Static Hand Gestures: Fingertips Detection based on Segmented images”, Journal of Computer Science, Science Publication, 2015, 11 (12):10901098, DOI: 10.3844/ jcssp.2015. 1090. 1098.

[24]Zaher Hamid Al-Tairi*, Rahmita Wirza Rahmat*, M. Iqbal Saripan*, and Puteri Suhaiza Sulaiman* , “Skin Segmentation Using YUV and RGB Color Spaces”, J Inf Process Syst, Vol.10, No.2, pp.283~299, June 2014, http://dx.doi.org/10.3745/ JIPS.02.0002, eISSN 2092-805X.

[25]Ioan-Gabriel Mircea, “An Evaluation of Color Spaces Used In Skin Color Detection”, INFORMATICA, VOL:LVII, NUMBER 3, 2012.

[26]Tarek Abd El-Hafeez, “A New System for Extracting and Detecting Skin Color Regions from PDF Documents”, IJCSE, Vol.02 No.09, 2010, 2838-2846.

[27]M.R.Tabbassum, A.U.Gias, M.M.Kamal, H. M. Muuctadir, M.Ibrahim, A.K Shakir, A.Imran, S.Islam, M.G.Rabbani, S.M. Khaled, M.S. Islam, Z. Begum, “Comparitive Study of Statistical Skin Detection Algorithms for Sub-Continental Human Images”, Information Technology Journal, 2010, Vol 9, Issue 4, PP 811-817, DOI 10.3923/ITJ. 2010.811.817.

[28]Marwa Jmal, Wided Souidene Mseddi, Rabah Attia and Anis Youssef, “Classification of Human Skin Color and its application to face recognition” MMEDIA 2014: the Sixth International Conference on Advances in Multimedia, IARIA, 2014, ISBN: 978-1-61208-320-9.

[29]Abdellatif Hajraoui, Mohamed Sabri, “Face Detection Algorithm based on Skin Detection, Watershed Method and Gobor Filters”, International Journal of Computer Application (0975-8887), Vole: 94-No. 6, May 2014.

[30]Chiunhsiun Lin, Ching-Hung Su, Hsuan Shu Huang, and Kuo-Chin Fan, “Colour Image Segmentation Using Relative Values of RGB in Various Illumination Circumstances”, International Journal of Computers, Issue 2, Volume 5, 2011.

[31]Ghazali Osman1, Muhammad Suzuri Hitam2 and Mohd Nasir Ismail, “Enhanced Skin Color Classifier Using RGB Ratio Model”, International Journal on Soft Computing (IJSC), Vol.3, No.4, November 2012.

[32]Chelsia Amy Doukim, Jamal Ahmed Dargham & Ali Chekima, “Comparison of Three Color spaces in Skin Detection”, BORNEO SCIENCE, 24 MARCH 2009, PP-75-81.

[33]Vandana. S. Bhat and Jagdeesh D. Pujari, “” Face detection system using HSV color model and morphing operation”, International Journal of current Engineering and Technology, ISSN 2277-4106, (NCWSE 2013).

[34]Dhia A. Alzubaydi, Samar A. Yousif, “Face Clip Detection System Using HSV Color Model”, International Journal of Innovative Research in Advanced Engineering (IJIRAE) ISSN: 2349-2163, Volume 1 Issue 11 (November 2014).

[35]Iyad Aldasouqi, Mahmoud Hassan, “Human Face Detection System Using HSV”, Recent Researches in Circuits, Systems, Electronics, Control & Signal Processing, ISBN: 978-960-474-262-2.

[36]Zhang Qiu-yu, Lu Jun-chi, Zhang Mo-yi, Duan Hong-xiang and Lv Lu, “Hand Gesture Segmentation Method Based on YCbCr Color Space and K-Means Clustering”, International Journal of Signal Processing, Image Processing and Pattern Recognition, Vol. 8, No. 5 (2015), pp. 105-116. http://dx.doi.org/10.14257/ijsip.2015.8.5. 11.

[37]Jalilian, Abdolah Chalechale, “Face and Hand shape segmentation using statistical detection for sign language recognition”, Computer Science and Information Technology 1(3):196-201, 2013, DOI 10.13189/csit.2013.010305.

[38]Amanpreet Kaur, B.V Kranthi, “ Comparison between YCbCr Color Space and CIELab Color Space for Skin Color Segmentation”, International Journal of Applied Information Systems (IJAIS) – ISSN : 2249-0868 Foundation of Computer Science FCS, New York, USA Volume 3– No.4, July 2012 – www.ijais.org.

[39]Manju, Deepika, Dr. Harish Rohil, “Real Time Hand Gesture Recognition Using CIELab Colour Space Model” International Journal of Computer & Organization Trends – Volume 5 – February 2014, ISSN: 2249-2593.

[40]Ahmed M.Mharib, Mohammad Hamiruce Marhaban, “Pixel Based Skin Color Detection Techniques Evaluation”, Pertanika J. Sci. & Technol.15(2):131-137 (2007), ISSN:0128-7680, Vol.15, No. 2. 2007.

[41]P.Kakumanu, S.Makrogiannis, N. Bourbakis, “ A survey of Skin color modeling and detection methods”, Pattern Recognition 40, 2007, 1106-1122

[42]Iram Noreen, “A systematic Survey of skin Detection Algorithms, Application and issues”, J.Appl. environ.Biol.Sci., 4(9s) 231-238,2014, ISSN:2090-4274.

[44]C.Prema, D.Manimegalai, “ Survey on Skin Tone Detection using Color Spaces” International Journal of Applied Information Systems (IJAIS) – ISSN : 2249-0868 Foundation of Computer Science FCS, New York, USA Volume 2– No.2, May 2012 – www.ijais.org.

[45]Mohammad Reza Mahmoodi, Sayed Masoud Sayedi, “A Comprehensive Survey on Human Skin Detection”, I.J. Image, Graphics and Signal Processing, 2016, 5, 1-35 Published Online May 2016 in MECS (http://www.mecs-press.org/) DOI: 10.5815/ijigsp.2016.05.01.

[46]Preei.S.Ratnaparkhi, Devesh D. Nawgaje, “Comparative Study of AI Based Gesture recognition”, International Journal of emerging Trends in Electrical and Electronics (IJETEE), Vol1. Issue 3. March 2013.

[47]Mokhtar m. Hasan1, pramod k. Mishra2, “Novel Algorithm for Skin Color Based Segmentation Using Mixture of GMMS”, Signal & Image Processing: An International Journal (SIPIJ) Vol.4, No.4, August 2013.

[48]Noor A. Ibraheem, Rafiqul Z. Khan, Mokhtar M. Hasan, “ Comparative Study of Skin Color based Segmentation Techniques” International Journal of Applied Information Systems (IJAIS) – ISSN : 2249-0868 Foundation of Computer Science FCS, New York, USA Volume 5, No. 10, August 2013 – www.ijais.org.

[49]Fan Hai Xiang and Shahrel Azmin Suandi, Senior Member, IACSIT, “Fusion of Multi Color Space for Human Skin Region Segmentation”, International Journal of Information and Electronics Engineering, Vol. 3, No. 2, March 2013, DOI: 10.7763/IJIEE.2013.V3.292.

[50]Mohamed Abdou Berbar, “ Novel Colors Correction Approaches for Natural Scenes and Skin Detection Techniques”, International Journal of Video & Image Processing and Network Security IJVIPNS-IJENS, Vol: 11 No: 02 114602-8383 IJVIPNS-IJENS © April 2011 IJENS.

[51]Bencheriet Chemesse Ennehar, Oudjani Brahim, Tebbikh Hicham, “An Appropriate Color Space to Improve Human Skin Detection”, INFOCOMP, v. 9, n. 4, p. 01–10, dez. 2010.

[52]Anand G. Buddhikot, Nitin M. Kulkarni, Arvind D. Shaligram, “Multimedia Access through Gesture Interface for Infotainment System”, IJACECT, ISSN (Print): 2319-2526, Volume-5, Issue-3-4, 2016.

[53]Ravi Subban, and Richa Mishra1, “Combining Color Spaces for Human Skin Detection in Color Images using Skin Cluster Classifier”, Proc. of Int. Conf. on Advances in Recent Technologies in Electrical and Electronics© 2013 ACEEE, DOI: 03.LSCS.2013.5.50.

[54]S. Chitra, G. Balakrishnan, “Comparative Study for Two Color Spaces HSCbCr and YCbCr in Skin Color Detection”, Applied Mathematical Sciences, Vol. 6, 2012, no. 85, 4229 – 4238.

[55]Wei Ren Tan, Chee Seng Chan, “A fusion Approach for Efficient Human Skin Detection”, IEEE Transactions on INFFORMATICS, Vol 8.No 1 February 2012, 155-3203.

[56]Patrick Sebastian1, Yap Vooi Voon2, and Richard Comley3, “Colour Space Effect on Tracking in Video Surveillance”, International Journal on Electrical Engineering and Informatics - Volume 2, Number 4, 2010.

[57]Gururaj P Surampalli, Dayanand J, Dhananjay M, “An Analysis of Skin Pixel Detection using DifferentSkin Color Extraction Techniques” International Journal of Computer Applications (0975 - 8887) Volume 54 - No. 17, September 2012.

[58]Kazi Tanvir Ahmed Siddiqui1 and Abu Wasif, “Skin Detection of Animation Characters”, International Journal on Soft Computing (IJSC) Vol.6, No. 1, February 2015.

[59]Neetu saini1, Hari Singh, “Comparison of Two Different Approaches for Multiple Face Detection In Color Images”, International Journal of Innovative Research In Electrical, Electronics, Instrumentation And Control Engineering, Vol. 3, issue 1, January 2015.

[60]Mohd Zamri Osman, Mohd Aizaini Maarof and Mohd Foad Rohani, “Suat Akyol, Ulrich Canzler, Klaus Bengler, Wolfgang Hahn, “Gesture Control for use in Automobiles”, MVAZOOO IAPR Workshop on Machine Vision Applications, Nov. 28-30. 2000. The University of Tokyo, Japan.

[61]A. Riener, A. Ferscha, F. Bachmair, P. Hagmüller, A. Lemme, D. Improved Dynamic Threshold Method for Skin Colour Detection Using Multi-Colour Space”, American Journal of Applied Sciences 2016, 13 (2): 135.144, DOI: 10.3844/ ajassp.2016.135.144 A.

[62]Koh Klevan, Marsyita Hanafi and Abdul Ramli “Optimal Combination Of Color Components For Skin Detection”,2014 4th International Conference on Artificial Intelligence with Applications in Engineering and Technology, 978-1- 4799 -7910-3/14 $31.00 © 2014 IEEE, DOI 10.1109/ ICAIET. 2014.36.

[63]Sayantan Thakur, Sayantanu Paul, Ankur Mondal, Swagatam Das “Face Detection Using Skin Tone Segmentation”, 978-1-4673-0125-1 c_2011 IEEE.

[64]R. Vijayanandh, G. Balakrishnan, “ A hybrid Approach To Human Skin Region Detection”, ICTACT Journal on image and Video Processing , February 2011, Vol.01,Issue 3.

[65]Komal Seth, Nitish Gadgil,P.R.Futane, “A hybrid hand detection algorithm for human computer interaction using skin color and motion cues”, International Journal of Computer Applications (0975 – 8887) Volume 84 – No 2, December 2013.

[66]A.H. Ismail, M.S. Muhamad Azmi, M.A. Hashim, M. Nasir Ayob, M.S.M Hashim, Hassrizal H.B, “Development of a Webcam Based Lux Meter”, 2013 IEEE Symposium on Computers & Informatics.

[67]Swapnil S. Potnis, Asst. Prof. Aditi S. Jahagirdar,“Real Time Hand Gesture Recognition for Smart Classroom Environment”, International Journal of Computer Trends and Technology (IJCTT) – volume 17 number 2 – Nov 2014.

[68]Tay Lee Choo, Ong Hang See, “Illuminance Calibration of A Digital Camera based on Image Colour”, The 3rd National Graduate Conference (NatGrad2015), Universiti Tenaga Nasional, Putrajaya Campus, 8-9 April 2015, ISBN 978-967-5770-63-0.

International Journal of Image, Graphics and Signal Processing (IJIGSP)