International Conference on Computer and Knowledge Engineering

Home / 13th International Conference on Computer and Knowledge Engineering

Facial Emotion Recognition Under Mask Coverage Using a Data Augmentation Technique

Authors :

Aref Farhadipour¹ Pouya Taghipour²

1- IRI Broadcasting University 2- École de technologie supérieure (ETS) University

Keywords :

Facial Emotion Recognition،Convolutional Neural Network،Data Augmentation،Transfer Learning

Abstract :

Identifying human emotions using AI-based computer vision systems, when individuals wear face masks, presents a new challenge in the current Covid-19 pandemic. In this study, we propose a facial emotion recognition system capable of recognizing emotions from individuals wearing different types of face masks. A novel data augmentation technique was utilized to improve the performance of our model using four mask types for each face image. We evaluated the effectiveness of three convolutional neural networks, namely Alexnet, Squeezenet, and VGGFace2, that were trained using transfer learning. The experimental findings revealed that our model works effectively in multi-mask mode compared to single-mask mode. The VGGFace2 network achieved the highest accuracy rate, with 97.82% for the person-dependent mode and 74.21% for the person-independent mode using the JAFFE dataset. Additionally, we evaluated our proposed model using the UIBVFED dataset. Once again, the VGGFace2 network has demonstrated superior performance, with accuracies of 71.57% for the person-dependent mode and 57.44% for the person-independent mode. Moreover, we employed metrics such as precision, sensitivity, specificity, AUC, F1 score, and confusion matrix to measure our system's efficiency in detail. Additionally, the LIME algorithm was used to visualize CNN's decision-making strategy.

Papers List

List of archived papers

To Transfer or Not To Transfer (TNT): Action Recognition in Still Image Using Transfer Learning

Ali Soltani Nezhad - Hojat Asgarian Dehkordi - Seyed Sajad Ashrafi - Shahriar Baradaran Shokouhi

Lossless Watermarking in Encrypted Triangular Mesh Models Based on Optimized Vertex Estimation and Error Histogram Shifting

Alireza Ghaemi - Habibollah Danyali - Kamran Kazemi - Zahra Qodrati - Amirhossein Ghaemi - Seyedeh Masoumeh Taji

Artificial Intelligence applications addressing different aspects of the Covid-19 crisis and key technological solutions for future epidemics control

Nadia Khalili - Hojatollah Hamidi

Identification of Botnets and Nodes Attacking Smart Cities by Majority Voting Mechanism and Feature Selection

Maliheh Araghchi - Nazbanoo Farzaneh

Capturing Local and Global Features in Medical Images by Using Ensemble CNN-Transformer

Javad Mirzapour Kaleybar - Hooman Saadat - Hooman Khaloo

Evaluating the Impact of Traveling on COVID-19 Prevalence and Predicting the New Confirmed Cases According to the Travel Rate Using Machine Learning: A Case Study in Iran

Anita Ghandehari - Soheil Shirvani - Hadi Moradi

Using Deep Learning for Classification of Lung Cancer on CT Images in Ardabil Province

Mohammad Ali Javadzadeh Barzaki - Jafar Abdollahi - Mohammad Negaresh - Maryam Salimi - Hadi Zolfeghari - Mohsen Mohammadi - Asma Salmani - Rona Jannati - Firouz Amani

The process of multi class fake news dataset generation

Sajjad Rezaei - Mohsen Kahani - Behshid Behkamal

Efficient Vision Transformer for Accurate Traffic Sign Detection

Javad Mirzapour Kaleybar - Hooman Khaloo - Avaz Naghipour

Impossible differential and zero-correlatin linear cryptanalysis of Marx, Marx2, Chaskey andSpeck32

Mahshid Saberi - Nasour Bagheri - Sadegh Sadeghi

Samin Hamayesh - Version 42.2.1