0% Complete
Home
/
14th International Conference on Computer and Knowledge Engineering
Attention-Boosted Ensemble of Pre-trained Convolutional Neural Networks for Accurate Diabetic Retinopathy Detection
Authors :
Benyamin Mirab Golkhatmi
1
Mohammad Hossein Moattar
2
1- Department of Computer Engineering Mashhad Branch, Islamic Azad University Mashhad, Iran
2- Department of Computer Engineering Mashhad Branch, Islamic Azad University Mashhad, Iran
Keywords :
Diabetic retinopathy،Deep transfer learning،Fine-tuning،Model ensemble،EfficientNetB0،EfficientNetB1،Attention mechanism
Abstract :
Early and accurate detection of diabetic retinopathy (DR) is crucial for preserving vision. Extracting informative and global features that facilitate precise and reliable decision-making is essential. Convolutional neural networks (CNNs), known for their high accuracy, are well-suited for this application. However, these models are susceptible to data scarcity, a challenge that can be mitigated through transfer learning. Additionally, model ensembles have proven effective in similar domains. This study proposes the use of two pre-trained CNNs from the EfficientNet family, specifically EfficientNetB0 and EfficientNetB1, in conjunction, and combines the features from both models to enhance decision-making. A Multi-Head Attention layer is incorporated to extract global and region-independent features, further improving representation. Consequently, the model can focus on the most critical areas of the image, thereby increasing detection accuracy. The proposed approach is evaluated on two datasets, yielding impressive results in binary classification (DR or No-DR) on the IDRiD dataset, it achieved an accuracy of 99.07% and an F1 score of 99.02%, while on the APTOS dataset, it attained an accuracy of 99.19% and an F1 score of 99.07%. These findings illustrate the effectiveness of combining CNNs with attention mechanisms for the accurate and timely diagnosis of DR.
Papers List
List of archived papers
Early detection of Parkinson’s disease using Convolutional Neural Networks on SPECT images
Reyhaneh Dehghan - Marjan Naderan - Seyyed Enayatallah Alavi
Explainable Error Detection Method for Structured Data using HoloDetect framework
Abolfazl Mohajeri Khorasani - Sahar Ghassabi - Behshid Behkamal - Mostafa Milani
Enhancing Vehicle Make and Model Recognition with 3D Attention Modules
Narges Semiromizadeh - Omid Nejati Manzari - Shahriar B. Shokouhi - Sattar Mirzakuchaki
Cluster Sampling: A Cluster-Driven Sampling Strategy for Deep Metric Learning
Hamideh Rafiee - Ahmad Ali Abin - Seyed Soroush Majd
Segmentation of Hard Exudates in Retinal Fundus Images Using BCDU-Net
Nafise Ameri - Nasser Shoeibi - Mojtaba Abrishami
Paddy Plant Stress Identification Using Few-Shot Learning Framework
Ervin Gubin Moung - Pavindrah Naidu a/l Narayanasamy Naiidu - Maisarah Mohd Sufian - Valentino Liaw - Ali Farzamnia - Lorita Angeline
Trust Management Enhancement for the Internet of Things: a Smart Contract Approach
Amin Rouzbahani - Fattaneh Taghiyareh
An Overview of Regression Methods in Early Prediction of Movie Ratings
Houmaan Chamani - Zhivar Sourati Hassanzadeh - Behnam Bahrak
Hate Sentiment Recognition System For Persian Language
Pegah Shams jey - Arash Hemmati - Ramin Toosi - Mohammad ali Akhaee
Divide and Conquer Approach to Long Genomic Sequence Alignment
Mahmoud Naghibzadeh - Samira Babaei - Behshid Behkmal - Mojtaba Hatami
more
Samin Hamayesh - Version 41.5.3