Mahesh U Nagaral; T Hanumantha Reddy

Hybrid Approach for Facial Expression Recognition using HJDLBP and LBP Histogram in Video Sequences

Full Text (PDF, 928KB), PP.1-9

Views: 0 Downloads: 0

Author(s)

Mahesh U Nagaral ^1,* T Hanumantha Reddy ²

1. Dept. Computer Science and Engineering, B.L.D.E.A’s V. P. Dr. P. G. Halakatti College of Engineering and Technology, Vijayapur, India.

2. Dept. Computer Science and Engineering, RYMEC College of Engineering and Technology, Bellary, India.

* Corresponding author.

DOI: https://doi.org/10.5815/ijigsp.2018.02.01

Received: 28 Sep. 2017 / Revised: 18 Oct. 2017 / Accepted: 7 Nov. 2017 / Published: 8 Feb. 2018

Index Terms

Facial expression, Viola-Jones, LBP his-togram, High order joint DLBP, Support Vector Machine

Abstract

Any kind of compassionate thoughts can't be expressed through words, but it appears on their facial expression. So, the facial expression reveals the emotions of individuals. The recognition of such emotions can be understood correctly or sometimes ambiguously from the opponent. Hence, there is a scope for automatic facial expression recognition (FER) in the context of image processing. The FER system has three different phases: face detection, feature extraction and expression classifi-cation. In face detection phase, Viola Jones face detector is used to crop the original image such that only the face region is retained by removing the unwanted region. In feature extraction stage, High-order Joint Derivative Lo-cal Binary Pattern (HJDLBP) and Local Binary Pattern (LBP) histogram algorithms are used for extracting fea-tures from the cropped image. In last stage, Support Vec-tor machine (SVM) classifier is used in finding the precise facial expression.CK+ dataset has been used for training and testing, which consist of 442 image samples. We have considered six different universal possible ex-pressions such as, happy, anger, disgust, fear, surprised, and sad for identification. The experimental results indi-cate that the overall accuracy of the proposed system was 74.8%, which is high compare to the results available in literature.

Cite This Paper

Mahesh U Nagaral, T Hanumantha Reddy," Hybrid Approach for Facial Expression Recognition using HJDLBP and LBP Histogram in Video Sequences", International Journal of Image, Graphics and Signal Processing(IJIGSP), Vol.10, No.2, pp. 1-9, 2018. DOI: 10.5815/ijigsp.2018.02.01

Reference

[1]B. Hasani, M. M. Arzani, M. Fathy, and K. Raahemifar, “Facial expression recognition with discriminatory graph-ical models,” 2nd International Conference of Signal Processing and Intelligent Systems, 2016, pp. 1–7.

[2]Shu An and Qiuqi Ruan, “3D Facial expression recogni-tion Algorithm using Local Threshold Binary Pattern and Histogram of Oriented Gradient”, IEEE 13th International Conference on Signal Processing (ICSP), 2016, November, pp. 265-270.

[3]A. V. Anusha, J. K. Jayasree, A. Bhaskar, and R. P. Aneesh, “Facial expression recognition and gender classi-fication using facial patches,” International Conference on Communication Systems and Networks, 2016, pp. 200–204.

[4]F. Lu and J. Huang, “An improved local binary pattern operator for texture classification,” IEEE International Conference on Acoustics, Speech and Signal Processing ,2016, pp. 1308–1311.

[5]N. Sheng, Y. Cai, C. Zhan, Changyan Qiu, Yize Cui, and Xurong Gao, “3D facial expression recognition using dis-tance features and LBP features based on automatically detected keypoints,” 9th International Congress on Image and Signal Processing, BioMedical Engineering and In-formatics (CISP-BMEI), 2016, pp. 396–401.

[6]S. M. Tabatabaei and A. Chalechale, “HJDLBP: A novel texture descriptor and its application in face recogni-tion,”The International Symposium on Artificial Intelli-gence and Signal Processing (AISP),2015, pp. 154–158.

[7]J. Kumari, R. Rajesh, and K. M. Pooja, “Facial Expression Recognition: A Survey,” Procedia Computer Science, vol. 58, pp. 486–491, 2015.

[8]Y. Muttu and H. G. Virani, “Effective face detection, feature extraction & neural network based approaches for facial expression recognition,” International x Conference on Information Processing, 2015, pp. 102–107.

[9]D. Bforuah, K. K. Sarma, and A. K. Talukdar, “Different face regions detection based facial expression recognition,” 2nd International Conference on Signal Processing and Integrated Networks, 2015, pp. 459–464.

[10]S. M. Tabatabaei and A. Chalechale, “Combination of high order joint derivative local binary pattern (HJDLBP) and radial partitioning for automatic facial expression recognition,” International Congress on Technology, Communication and Knowledge ,2015, pp. 86–91.

[11]H. Gao, A. Yuce, and J.-P. Thiran, “Detecting emotional stress from facial expressions for driving safety,” IEEE International Conference on Image Processing, 2014, pp. 5961–5965.

[12]L. Xie, H. Wei, W. Yang, and K. Zhang, “Video-based facial expression recognition using histogram sequence of local Gabor binary patterns from three orthogonal planes,” Proceedings of the 33rd Chinese Control Conference,2014, pp. 4772–4776.

[13]Andrew R. Webb and Keith D. Copsey. Statistical Pattern Recognition. Wiley, 2011.

[14]I. Kotsia and I. Pitas, “Real time facial expression recog-nition from image sequences using support vector ma-chines,” IEEE International Conference on Image Pro-cessing, 2005, p. II-966.

[15]P. Viola and M. J. Jones, “Robust Real-Time Face Detec-tion,” International Journal of Computer Vision, vol. 57, no. 2, pp. 137–154, May 2004.

[16]A. Mehrabian,”Communication without Words”, Psy-chology Today, Vol. 2, No. 4, pp. 53-56, 1968.

[17]P. Lucey, J.F. Cohn, T. Kanade, J. Saragih, Z. Ambadar and R. Institute, The extended Cohn-Kanade dataset (CK+): A complete dataset for action unit and emotion-specified expression, In IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2010: 94–101.

International Journal of Image, Graphics and Signal Processing (IJIGSP)