Elevating Facial Expression Detection: Empowered by VGG-19 and Weight- Normalized Gradient Boost Algorithm

Authors

  • Rajeshwari M Srinivas University
  • Krishna Prasad K

DOI:

https://doi.org/10.22399/ijcesen.521

Abstract

Facial expression recognition termed as FER, is one of the vital tasks which is able in mimicking the human ability and wellness. Face expression and other gestures delivered via face are some of the important aspects of conveying non-verbal communications which plays a vital role in interpersonal relations. This domain has a higher scope of research due to enhancing computer vision and human-computer interaction. With respect and consideration to these domain interest, DL has gained a reasonable approach in performing FER. Some of the state-of-art approaches encompassing the ML approaches have faced several cases of laybacks such as overfitting, computational complexity, less adaptable to higher and big datasets. Thus, considering these laybacks and in achieving accurate FER in aspects of bringing proximal levels of FER, the current approach deployed DL methods for both feature extraction from the input image and in classifying them. Deep multi-level feature extraction is performed using the VGG-19 model and Weight Normalized gradient boosting algorithm is adapted for classifying these expressions using the FER13 dataset. This dataset constitutes the input images, which are in ranges of 28,709 sample image data and about 3,589 image data for test. These input images are initially pre-processed for obtaining better accuracy rates when performing feature extraction and classifications. The complete model in effective FER is evaluated using the performance metrics comprising Accuracy (98%), Recall (99%), F1-score (98%) and the precision rates (97%). This analysis of the performance will aid in affirming the overall efficacy of the proposed system.  

References

J.-H. Kim, N. Kim, and C. S. J. a. p. a. Won, "Multi-Modal Facial Expression Recognition with Transformer-Based Fusion Networks and Dynamic Sampling," 2023.

C. Caglio, R. M. Darst, and S. Kalemli-Ozcan, (2022). Collateral heterogeneity and monetary policy transmission: Evidence from loans to smes and large firms. Working Paper. NATIONAL BUREAU OF ECONOMIC RESEARCH Cambridge, MA 02138 DOI 10.3386/w28685

M. Wafi, F. A. Bachtiar, F. J. I. J. o. E. Utaminingrum, and C. Engineering, (2023). Feature extraction comparison for facial expression recognition using adaptive extreme learning machine. International Journal of Electrical and Computer Engineering (IJECE) 13;1113-1122, DOI: 10.11591/ijece.v13i1.pp1113-1122

B. B. Mamatkulovich, M. S. Shuhrat o’g’li, and B. J. J. O. A. R. Jasurjonovich, (2023). SPECIAL DEEP CNN DESIGN FOR FACIAL EXPRESSION CLASSIFICATION WITH A SMALL AMOUNT OF DATA. Open Access Repository 4 (3), 472-478.

M. F. Bashir, A. R. Javed, M. U. Arshad, T. R. Gadekallu, W. Shahzad, M. O. J. A. T. o. A. Beg, et al., "Context-aware Emotion Detection from Low-resource Urdu Language Using Deep Neural Network," ACM Transactions on Asian and Low-Resource Language Information Processing, 22(5);1 - 30 https://doi.org/10.1145/352857vol. 22, pp. 1-30, 2023.

D. K. Jain, A. K. Dutta, E. Verdú, S. Alsubai, A. R. W. J. I. Sait, and V. Computing, (2023). An automated hyperparameter tuned deep learning model enabled facial emotion recognition for autonomous vehicle drivers. Image and Vision Computing 133;104659, https://doi.org/10.1016/j.imavis.2023.104659

Engin, M.A., Cavusoglu, B. (2019). Rotation invariant curvelet based image retrieval & classification via Gaussian mixture model and co-occurrence features. Multimed Tools Appl 78, 6581–6605. https://doi.org/10.1007/s11042-018-6368-8

Huddar, M.G., Sannakki, S.S. & Rajpurohit, V.S. (2020) Multi-level context extraction and attention-based contextual inter-modal fusion for multimodal sentiment analysis and emotion classification. Int J Multimed Info Retr 9;103–112. https://doi.org/10.1007/s13735-019-00185-8

Liu, X., Zhou, F. (2020). Improved curriculum learning using SSM for facial expression recognition. Vis Comput 36, 1635–1649. https://doi.org/10.1007/s00371-019-01759-7

Kansizoglou, I., Misirlis, E., Tsintotas, K.A., & Gasteratos, A. (2022). Continuous Emotion Recognition for Long-Term Behavior Modeling through Recurrent Neural Networks. Technologies.10;59

Xie, Y., Tian, W., Zhang, H. et al. (2023). Facial expression recognition through multi-level features extraction and fusion. Soft Comput 27, 11243–11258. https://doi.org/10.1007/s00500-023-08531-z

S. Siriwardhana, T. Kaluarachchi, M. Billinghurst and S. Nanayakkara, (2020). Multimodal Emotion Recognition With Transformer-Based Self Supervised Feature Fusion, in IEEE Access, 8;176274-176285, doi: 10.1109/ACCESS.2020.3026823.

I. P. Adegun and H. B. J. S. A. Vadapalli, (2020). Facial micro-expression recognition: A machine learning approach. 8;e00465,. https://doi.org/10.1016/j.sciaf.2020.e00465

M. Aly, A. Ghallab, and I. S. Fathi, (2023). Enhancing Facial Expression Recognition System in Online Learning Context Using Efficient Deep Learning Model, IEEE Access, 11;121419-121433.

M. Arul Vinayakam Rajasimman, R. K. Manoharan, N. Subramani, M. Aridoss, and M. G. Galety, (2022). Robust facial expression recognition using an evolutionary algorithm with a deep learning model," Applied Sciences, 13;468.

Bodavarapu, P.N., & Srinivas, P.V. (2021). Facial expression recognition for low resolution images using convolutional neural networks and denoising techniques. Indian Journal of Science and Technology. 14;971-983.

K. Xie, G. Cai, G. Kaddoum, and J. J. a. p. a. He, (2023). Performance Analysis and Resource Allocation of STAR-RIS Aided Wireless-Powered NOMA System,. https://doi.org/10.48550/arXiv.2301.08865

L. Zahara, P. Musa, E. P. Wibowo, I. Karim, and S. B. Musa, (2020). The facial emotion recognition (FER-2013) dataset for prediction system of micro-expressions face using the convolutional neural network (CNN) algorithm based Raspberry Pi, in 2020 Fifth international conference on informatics and computing (ICIC), 2020, pp. 1-9.

Saurav, S., Saini, R. & Singh, S. (2021). EmNet: a deep integrated convolutional neural network for facial emotion recognition in the wild. Appl Intell 51, 5543–5570. https://doi.org/10.1007/s10489-020-02125-0

Downloads

Published

2024-11-11

How to Cite

M, R., & K, K. P. (2024). Elevating Facial Expression Detection: Empowered by VGG-19 and Weight- Normalized Gradient Boost Algorithm. International Journal of Computational and Experimental Science and Engineering, 10(4). https://doi.org/10.22399/ijcesen.521

Issue

Section

Research Article