Please wait ...
0% Complete
Home
/
13th International Conference on Computer and Knowledge Engineering
Facial Emotion Recognition Under Mask Coverage Using a Data Augmentation Technique
Authors :
Aref Farhadipour
1
Pouya Taghipour
2
1- IRI Broadcasting University
2- École de technologie supérieure (ETS) University
Keywords :
Facial Emotion Recognition،Convolutional Neural Network،Data Augmentation،Transfer Learning
Abstract :
Identifying human emotions using AI-based computer vision systems, when individuals wear face masks, presents a new challenge in the current Covid-19 pandemic. In this study, we propose a facial emotion recognition system capable of recognizing emotions from individuals wearing different types of face masks. A novel data augmentation technique was utilized to improve the performance of our model using four mask types for each face image. We evaluated the effectiveness of three convolutional neural networks, namely Alexnet, Squeezenet, and VGGFace2, that were trained using transfer learning. The experimental findings revealed that our model works effectively in multi-mask mode compared to single-mask mode. The VGGFace2 network achieved the highest accuracy rate, with 97.82% for the person-dependent mode and 74.21% for the person-independent mode using the JAFFE dataset. Additionally, we evaluated our proposed model using the UIBVFED dataset. Once again, the VGGFace2 network has demonstrated superior performance, with accuracies of 71.57% for the person-dependent mode and 57.44% for the person-independent mode. Moreover, we employed metrics such as precision, sensitivity, specificity, AUC, F1 score, and confusion matrix to measure our system's efficiency in detail. Additionally, the LIME algorithm was used to visualize CNN's decision-making strategy.
Papers List
List of archived papers
Leveraging Self-Supervised Models for Automatic Whispered Speech Recognition
Aref Farhadipour - Homa Asadi - Volker Dellwo
Introducing Meta-Contrastive Adaptive Autoencoder to Tackle Cold-Start Challenges in Sparse Domains
Hossein Rashid - Erfan Arzhmand - Fatemeh Hosseini
Two-step thermal-aware routing algorithm in 3D NoC
Majid Nezarat - Masoume Momeni
Balanced Learning with Optimized Extra Trees Classifier for Reliable Lithology Identification in Imbalanced Well Log Data
Ali Daneshpour - Behnam Yousefimehr - Mehdi Ghatee
Designing an IT2 Fuzzy Rule-based System for Emotion Recognition Using Biological Data
Mahsa Keshtkar - Hooman Tahayori
Intelligent Adaptive Control of Wheeled Mobile Robots with MLP Neural Networks under Input Constraints
Soheil Sheikh ahmadi - Arash Rahmani
Enhancing Lighter Neural Network Performance with Layer-wise Knowledge Distillation and Selective Pixel Attention
Siavash Zaravashan - Sajjad Torabi - Hesam Zaravashan
Divide and Conquer Approach to Long Genomic Sequence Alignment
Mahmoud Naghibzadeh - Samira Babaei - Behshid Behkmal - Mojtaba Hatami
DEW-WIN: A Dynamic Energy-aware Window-based Scheduler for Mixed-criticality Systems
Mahin Moradiyan - Yasser Sedaghat - Pouria Hosseini - Yousef Rezazadeh
Facial Mask Wearing Condition Detection Using SSD MobileNetV2
Amirhossein Tighkhorshid - Yasamin Borhani - Javad Khoramdel - Esmaeil Najafi
more
Samin Hamayesh - Version 46.0.2