International Conference on Computer and Knowledge Engineering

Home / 15th International Conference on Computer and Knowledge Engineering

A Facial Deepfake Detection Approach using CNN-based Models, Swin Transformer and Classifier Fusion

Authors :

Alireza Honardoost¹ Mahdie Rahmati² Babak Nasersharif³

1- Faculty of Computer Engineering K. N. Toosi University of Technology 2- Faculty of Computer Engineering K. N. Toosi University of Technology 3- Faculty of Computer Engineering K. N. Toosi University of Technology

Keywords :

Deepfake Detection،Swin Transformer،CNN،VGG،ResNet،Classifier Fusion

Abstract :

Facial deepfake detection focuses on identifying manipulated images and videos generated by deep learning methods such as Generative Adversarial Networks (GANs) and autoencoders. Detection methods range from analyzing facial and physiological features to using deep learning models like Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs). In this paper, we propose a method based on combining CNNs and ViTs in the level of their decisions for classifying real or fake images. This combination is performed by different static classifier fusion methods on the probability outputs of classifiers. The used CNN models are VGG16 and ResNet50, and the used ViT model is Swin-Tiny. To evaluate the proposed method, the VidTIMIT and DeepfakeTIMIT datasets are employed. The results show that combining fine-tuned models leads to improved accuracy across dataset, outperforming the individual models.

Papers List

List of archived papers

Binary Classification of Capuchin Bird Calls via Spectrogram-Enhanced Frequency-Aware Convolutional Neural Networks

Samad Najjar-Ghabel - Shamim Yousefi - Reza Danandeh Bileh Savar

Impossible differential and zero-correlatin linear cryptanalysis of Marx, Marx2, Chaskey andSpeck32

Mahshid Saberi - Nasour Bagheri - Sadegh Sadeghi

Enhancing Vehicle Make and Model Recognition with 3D Attention Modules

Narges Semiromizadeh - Omid Nejati Manzari - Shahriar B. Shokouhi - Sattar Mirzakuchaki

Deep Learning-based Processing of Autonomous Vehicle Radar Data to Achieve High Resolution

Nima Abdolrahimi Shahamat - Vahideh Moghtadaiee - Esfandiar Mehrshahi

An Analysis of Botnet Detection Using Graph Neural Network

Faezeh Alizadeh - Mohammad Khansari

Optimizing Question-Answering Framework Through Integration of Text Summarization Model and Third-Generation Generative Pre-Trained Transformer

Ervin Gubin Moung - Toh Sin Tong - Maisarah Mohd Sufian - Valentino Liaw - Ali Farzamnia - Farashazillah Yahya

Multi-Fusion Ensemble CNN for Drug–Target Binding Affinity Prediction Using Transformer-Based Molecular and Protein Representations

Betsabeh Tanoori

LightFedSelect: A Lightweight Framework for Byzantine-Robust Federated Learning

Seyed Saeed Razavi - Seyed Arsalan Vasegh Rahim Parvar - Soroosh Dadashi Pakdeh - Mohammad Matin Rezaeifard - Morteza Mollaie Chafi - Reza Ebrahimi Atani

Hybrid Vision Transformer for Detection of Dentigerous Cysts in Dental Radiography Images

Reza Tavasoli - Arya VarastehNezhad - Hamed Farbeh

A New Time Series Approach in Churn Prediction with Discriminatory Intervals

Hedieh Ahmadi - Seyed Mohammad Hossein Hasheminejad