0% Complete
Home
/
14th International Conference on Computer and Knowledge Engineering
Attention-Boosted Ensemble of Pre-trained Convolutional Neural Networks for Accurate Diabetic Retinopathy Detection
Authors :
Benyamin Mirab Golkhatmi
1
Mohammad Hossein Moattar
2
1- Department of Computer Engineering Mashhad Branch, Islamic Azad University Mashhad, Iran
2- Department of Computer Engineering Mashhad Branch, Islamic Azad University Mashhad, Iran
Keywords :
Diabetic retinopathy،Deep transfer learning،Fine-tuning،Model ensemble،EfficientNetB0،EfficientNetB1،Attention mechanism
Abstract :
Early and accurate detection of diabetic retinopathy (DR) is crucial for preserving vision. Extracting informative and global features that facilitate precise and reliable decision-making is essential. Convolutional neural networks (CNNs), known for their high accuracy, are well-suited for this application. However, these models are susceptible to data scarcity, a challenge that can be mitigated through transfer learning. Additionally, model ensembles have proven effective in similar domains. This study proposes the use of two pre-trained CNNs from the EfficientNet family, specifically EfficientNetB0 and EfficientNetB1, in conjunction, and combines the features from both models to enhance decision-making. A Multi-Head Attention layer is incorporated to extract global and region-independent features, further improving representation. Consequently, the model can focus on the most critical areas of the image, thereby increasing detection accuracy. The proposed approach is evaluated on two datasets, yielding impressive results in binary classification (DR or No-DR) on the IDRiD dataset, it achieved an accuracy of 99.07% and an F1 score of 99.02%, while on the APTOS dataset, it attained an accuracy of 99.19% and an F1 score of 99.07%. These findings illustrate the effectiveness of combining CNNs with attention mechanisms for the accurate and timely diagnosis of DR.
Papers List
List of archived papers
Dynamic Knowledge Enhanced Neural Fashion Trend Forecasting with Quantile Loss
Fatemeh Rooholamini - Reza Azmi - Mobina Khademhossein - Maral Zarvani
Area-Efficient VLSI Implementation of Bit-Serial Multiplier Using Polynomial Basis over GF(2m)
Saeideh Nabipour - Javad Javidan - Gholamreza Zare Fatin
The process of multi class fake news dataset generation
Sajjad Rezaei - Mohsen Kahani - Behshid Behkamal
An Exploratory Study of the Relationship between SATD and Other Software Development Activities
Shima Esfandiari - Ashkan Sami
Joint mobility-aware offloading and UAV position optimization in Blockchain-enabled 5G
Zeinab Rabbani - Zeinab Movahedi
A Weighted TF-IDF-based Approach for Authorship Attribution
Ali Abedzadeh - Reza Ramezani - Afsaneh Fatemi
Real-Time Gender Recognition with a Deep Neural Network
Samad Azimi Abriz - Majid Meghdadi
SASIAF, An Scalable Accelerator For Seismic Imaging on Amazon AWS FPGAs
Mostafa Koraei - S.Omid Fatemi
Segmentation of Hard Exudates in Retinal Fundus Images Using BCDU-Net
Nafise Ameri - Nasser Shoeibi - Mojtaba Abrishami
Farsi Optical Character Recognition Using a Transformer-based Model
Fatemeh Asadi Zeydabadi - Elham Shabaninia - Hossein Nezamabadi-pour - Melika Shojaee
more
Samin Hamayesh - Version 41.3.1