International Conference on Computer and Knowledge Engineering

Home / 13th International Conference on Computer and Knowledge Engineering

Facial Emotion Recognition Under Mask Coverage Using a Data Augmentation Technique

Authors :

Aref Farhadipour¹ Pouya Taghipour²

1- IRI Broadcasting University 2- École de technologie supérieure (ETS) University

Keywords :

Facial Emotion Recognition،Convolutional Neural Network،Data Augmentation،Transfer Learning

Abstract :

Identifying human emotions using AI-based computer vision systems, when individuals wear face masks, presents a new challenge in the current Covid-19 pandemic. In this study, we propose a facial emotion recognition system capable of recognizing emotions from individuals wearing different types of face masks. A novel data augmentation technique was utilized to improve the performance of our model using four mask types for each face image. We evaluated the effectiveness of three convolutional neural networks, namely Alexnet, Squeezenet, and VGGFace2, that were trained using transfer learning. The experimental findings revealed that our model works effectively in multi-mask mode compared to single-mask mode. The VGGFace2 network achieved the highest accuracy rate, with 97.82% for the person-dependent mode and 74.21% for the person-independent mode using the JAFFE dataset. Additionally, we evaluated our proposed model using the UIBVFED dataset. Once again, the VGGFace2 network has demonstrated superior performance, with accuracies of 71.57% for the person-dependent mode and 57.44% for the person-independent mode. Moreover, we employed metrics such as precision, sensitivity, specificity, AUC, F1 score, and confusion matrix to measure our system's efficiency in detail. Additionally, the LIME algorithm was used to visualize CNN's decision-making strategy.

Papers List

List of archived papers

A Review on Machine Learning Methods for Workload Prediction in Cloud Computing

Mohammad Yekta - Hadi Shahriar Shahhoseini

An Effective Connectomics Approach for Diagnosing ADHD using Eyes-open Resting-state MEG

Nastaran Hamedi - Ali Khadem - Sajjad Vardast - Mehdi Delrobaei - Abbas Babajani-Feremi

TrackMine: Topic Tracking in Model Mining using Genetic Algorithm

Mohammad Sajad Kasaei - Mohammadreza Sharbaf - Afsaneh Fatemi - Bahman Zamani

FGM Copula based Analysis of Coverage Region for Wireless Three-User Multiple Access Channel with Correlated Channel Coefficients

Mona Sadat Mohsenzadeh - Ghosheh Abed Hodtani

Adversarial Robustness Evaluation with Separation Index

Bahareh Kaviani Baghbaderani - Afsaneh Hasanebrahimi - Ahmad Kalhor - Reshad Hosseini

The application of Brain Drain Optimization algorithm on static drone placement problem

Mohammad Mehdi Samimi - Alireza Basiri

Brain Age Estimation with Twin Vision Transformer using Hippocampus Information Applicable to Alzheimer Dementia Diagnosis

Zahra Qodrati - Seyedeh Masoumeh Taji - Amirhossein Ghaemi - Habibollah Danyali - Kamran Kazemi - Alireza Ghaemi

A supervised approach using transformer networks for the detection of turning-related anomalies in urban intersections

Mohammad Mahdi HajiAbadi - Manoochehr Nahvi

Performance Evaluation Study of Color Space Selection In Video Based Facial Expression Recognition Using Deep Neural Networks For Sentiment Analysis

Phee Wei Qin - Ervin Gubin Moung - Ali Farzamnia - Farashazillah Yahya - John Julius Danker Khoo - Maisarah Mohd Sufian

Dynamic Knowledge Enhanced Neural Fashion Trend Forecasting with Quantile Loss

Fatemeh Rooholamini - Reza Azmi - Mobina Khademhossein - Maral Zarvani