Please wait ...
0% Complete
Home
/
14th International Conference on Computer and Knowledge Engineering
Attention-Boosted Ensemble of Pre-trained Convolutional Neural Networks for Accurate Diabetic Retinopathy Detection
Authors :
Benyamin Mirab Golkhatmi
1
Mohammad Hossein Moattar
2
1- Department of Computer Engineering Mashhad Branch, Islamic Azad University Mashhad, Iran
2- Department of Computer Engineering Mashhad Branch, Islamic Azad University Mashhad, Iran
Keywords :
Diabetic retinopathy،Deep transfer learning،Fine-tuning،Model ensemble،EfficientNetB0،EfficientNetB1،Attention mechanism
Abstract :
Early and accurate detection of diabetic retinopathy (DR) is crucial for preserving vision. Extracting informative and global features that facilitate precise and reliable decision-making is essential. Convolutional neural networks (CNNs), known for their high accuracy, are well-suited for this application. However, these models are susceptible to data scarcity, a challenge that can be mitigated through transfer learning. Additionally, model ensembles have proven effective in similar domains. This study proposes the use of two pre-trained CNNs from the EfficientNet family, specifically EfficientNetB0 and EfficientNetB1, in conjunction, and combines the features from both models to enhance decision-making. A Multi-Head Attention layer is incorporated to extract global and region-independent features, further improving representation. Consequently, the model can focus on the most critical areas of the image, thereby increasing detection accuracy. The proposed approach is evaluated on two datasets, yielding impressive results in binary classification (DR or No-DR) on the IDRiD dataset, it achieved an accuracy of 99.07% and an F1 score of 99.02%, while on the APTOS dataset, it attained an accuracy of 99.19% and an F1 score of 99.07%. These findings illustrate the effectiveness of combining CNNs with attention mechanisms for the accurate and timely diagnosis of DR.
Papers List
List of archived papers
Reversible Data Insertion in Encryption Domain Based on Reduced Quad Difference Expansion
Alireza Ghaemi - Mohammad Zare Ehteshami - Amirhossein Ghaemi
The application of Brain Drain Optimization algorithm on static drone placement problem
Mohammad Mehdi Samimi - Alireza Basiri
FedFog: A Serverless and Privacy-Aware Federated Learning Simulator for Edge–Fog Networks
Seyed Vahid Hashemi Nik - Seyed Mohammad Mahdi Asaadi - Somayeh Sobati-M
Data-Optimized Dry Rock Property Prediction Using Ensemble and Kernel-Based ML Methods
Esmael Makarian - Hassanreza Ghasemitabar - Alireza Behinrad - Mahdi Fathi - Andisheh Alimoradi - Ayub Elyasi
BioBERT-based SNP-traits Associations Extraction from Biomedical Literature
Mohammad Dehghani - Behrouz Bokharaeian - Zahra Yazdanparast
An influence maximization algorithm based on community detection using topological features
Zahra Aghaee - Afsaneh Fatemi
Distilling Knowledge from CNN-Transformer Models for Enhanced Human Action Recognition
Hamid Ahmadabadi - Omid Nejati Manzari - Ahmad Ayatollahi
An Improved and Accurate Measure for Mining Correlated High-utility Itemsets
Amir Masoud Heidari Orojloo - Morteza Keshtkaran
An optimal workflow scheduling method in cloud-fog computing using three-objective Harris-Hawks algorithm
Ahmadreza Montazerolghaem - Maryam Khosravi - Fatemeh Rezaee
UAV-based Firefighting by Multi-agent Reinforcement Learning
Reza Shami Tanha - Mohsen Hooshmand - Mohsen Afsharchi
more
Samin Hamayesh - Version 46.0.2