International Conference on Computer and Knowledge Engineering

Home / 14th International Conference on Computer and Knowledge Engineering

Attention-Boosted Ensemble of Pre-trained Convolutional Neural Networks for Accurate Diabetic Retinopathy Detection

Authors :

Benyamin Mirab Golkhatmi¹ Mohammad Hossein Moattar²

1- Department of Computer Engineering Mashhad Branch, Islamic Azad University Mashhad, Iran 2- Department of Computer Engineering Mashhad Branch, Islamic Azad University Mashhad, Iran

Keywords :

Diabetic retinopathy،Deep transfer learning،Fine-tuning،Model ensemble،EfficientNetB0،EfficientNetB1،Attention mechanism

Abstract :

Early and accurate detection of diabetic retinopathy (DR) is crucial for preserving vision. Extracting informative and global features that facilitate precise and reliable decision-making is essential. Convolutional neural networks (CNNs), known for their high accuracy, are well-suited for this application. However, these models are susceptible to data scarcity, a challenge that can be mitigated through transfer learning. Additionally, model ensembles have proven effective in similar domains. This study proposes the use of two pre-trained CNNs from the EfficientNet family, specifically EfficientNetB0 and EfficientNetB1, in conjunction, and combines the features from both models to enhance decision-making. A Multi-Head Attention layer is incorporated to extract global and region-independent features, further improving representation. Consequently, the model can focus on the most critical areas of the image, thereby increasing detection accuracy. The proposed approach is evaluated on two datasets, yielding impressive results in binary classification (DR or No-DR) on the IDRiD dataset, it achieved an accuracy of 99.07% and an F1 score of 99.02%, while on the APTOS dataset, it attained an accuracy of 99.19% and an F1 score of 99.07%. These findings illustrate the effectiveness of combining CNNs with attention mechanisms for the accurate and timely diagnosis of DR.

Papers List

List of archived papers

R2-BAC: A Novel Blockchain and IoT-Based Access Control Model for Supply Chain Management

Sadegh Sohani - Farnaz Kamranfar - Haleh Amintoosi - Mohammad Allahbakhsh

Efficient T-Count Fault-tolerant Quantum Clifford+T Multiplexer

Negin Mashayekhi - Shekoofeh Moghimi - Mohammad Reza Reshadinezhad

Adversarial Robustness Evaluation with Separation Index

Bahareh Kaviani Baghbaderani - Afsaneh Hasanebrahimi - Ahmad Kalhor - Reshad Hosseini

Efficient Vision Transformer for Accurate Traffic Sign Detection

Javad Mirzapour Kaleybar - Hooman Khaloo - Avaz Naghipour

A Review on Machine Learning Methods for Workload Prediction in Cloud Computing

Mohammad Yekta - Hadi Shahriar Shahhoseini

Farsi Text in Scene: A new dataset

Ali Salmasi - Ehsanollah Kabir

Using Deep Learning for Classification of Lung Cancer on CT Images in Ardabil Province

Mohammad Ali Javadzadeh Barzaki - Jafar Abdollahi - Mohammad Negaresh - Maryam Salimi - Hadi Zolfeghari - Mohsen Mohammadi - Asma Salmani - Rona Jannati - Firouz Amani

Performance Evaluation Study of Color Space Selection In Video Based Facial Expression Recognition Using Deep Neural Networks For Sentiment Analysis

Phee Wei Qin - Ervin Gubin Moung - Ali Farzamnia - Farashazillah Yahya - John Julius Danker Khoo - Maisarah Mohd Sufian

Developing Convolutional Neural Networks using a Novel Lamarckian Co-Evolutionary Algorithm

Zaniar Sharifi - Khabat Soltanian - Ali Amiri

Deep Learning-based Processing of Autonomous Vehicle Radar Data to Achieve High Resolution

Nima Abdolrahimi Shahamat - Vahideh Moghtadaiee - Esfandiar Mehrshahi