Please wait ...
0% Complete
Home
/
15th International Conference on Computer and Knowledge Engineering
Multimodal Deep Learning Framework for PTSD Detection during Sleep via EEG and Biosignal Fusion
Authors :
Danial Eskandari Faruji
1
Amir Akhavan Saffar
2
Mobina Ansari Astaneh
3
1- Computer engineering department, Hakim Sabzevari University
2- Faculty of Computer Engineering and Information Technology of Sadjad University
3- Faculty of Computer Engineering and Information Technology of Sadjad University
Keywords :
PTSD Detection،EEG signals،Multimodal Fusion،Sleep Analysis،CNN-BiLSTM
Abstract :
Post-Traumatic Stress Disorder (PTSD) disrupts sleep, causing nightmares, insomnia, and autonomic dysregulation that demand objective diagnostic tools. Existing EEG-based studies often focus on resting-state or unimodal analysis, missing the potential of multimodal sleep data to capture dynamic neurophysiological patterns. We introduce a novel deep learning framework that integrates EEG and ECG signals for automated, non-invasive PTSD detection during sleep, thereby enhancing clinical utility. Using a dataset of 28 subjects from Amsterdam UMC [1], we pre-process EEG data (Fpz-Cz, Pz-Oz, 100 Hz) into spectrograms via Short-Time Fourier Transform. We also extract Heart Rate Variability (HRV) from ECG signals. The core of our system is a hybrid CNN-BiLSTM architecture, which utilizes convolutional layers for spatial EEG feature extraction, bidirectional LSTMs for temporal modeling, and a multi-head attention mechanism for multimodal fusion. To address class imbalance, we use SMOTE and evaluate performance with stratified 10-fold cross-validation. The model achieves a 96% accuracy, 96% F1-score, and a 1.00 AUC, which significantly surpasses unimodal baselines (EEG-only CNN: 76.8%, SVM: 74.1%) [2]. Our ablation studies confirm that multimodal fusion boosts the detection of PTSD biomarkers, such as REM disruptions and elevated theta power. This framework provides a scalable and interpretable solution for PTSD detection, suitable for clinical diagnostics and integration into wearable devices, which advances real-time mental health monitoring.
Papers List
List of archived papers
Deep Learning Feature Extraction for COVID-19 Detection Algorithm using Computerized Tomography Scan
Maisarah Mohd Sufian - Ervin Gubin Moung - Chong Joon Hou - Ali Farzamnia
Adaptive-A-GCRNN: Enhancing Real-time Multi-band Spectrum Prediction through Attention-based Spatial-Temporal Modeling
Seyed majid Hosseini - Seyedeh Mozhgan Rahmatinia - Seyed Amin Hosseini Seno - Hadi Sadoghi yazdi
CSI-Based Human Activity Recognition using Convolutional Neural Networks
Parisa Fard Moshiri - Mohammad Nabati - Reza Shahbazian - Seyed Ali Ghorashi
Towards Low-Overhead Mitigation of Trojan Bit-Flip Attacks on DNNs via Causal Inference
Bahare Gholami - Mohsen Raji
Explainable Error Detection Method for Structured Data using HoloDetect framework
Abolfazl Mohajeri Khorasani - Sahar Ghassabi - Behshid Behkamal - Mostafa Milani
To Transfer or Not To Transfer (TNT): Action Recognition in Still Image Using Transfer Learning
Ali Soltani Nezhad - Hojat Asgarian Dehkordi - Seyed Sajad Ashrafi - Shahriar Baradaran Shokouhi
An Exploratory Study of the Relationship between SATD and Other Software Development Activities
Shima Esfandiari - Ashkan Sami
Reliability Evaluation of 4:2 Compressors Based on Hammock Networks
Farshad Safaei - Mohammad mahdi Emadi Kouchak - Sara Talebpour
Standardized ReACT Logits: An Effective Approach for Anomaly Segmentation in Self-driving Cars
Mahdi Farhadi - Seyede Mahya Hazavei - Shahriar Baradaran Shokouhi
A Facial Deepfake Detection Approach using CNN-based Models, Swin Transformer and Classifier Fusion
Alireza Honardoost - Mahdie Rahmati - Babak Nasersharif
more
Samin Hamayesh - Version 46.0.2