Please wait ...
0% Complete
Home
/
15th International Conference on Computer and Knowledge Engineering
Plant Disease Detection Using Dynamic Knowledge Distillation and Attention Mechanism
Authors :
Mohammad Ghasemi Arian
1
Mohammad Hossein Yaghmaee Moghaddam
2
1- Ferdowsi university of mashhad
2- Ferdowsi university of mashhad
Keywords :
Knowledge Distillation،Teacher،Student،PlantDoc،Attention،ResNet
Abstract :
One of the key aspects of modern agriculture is the detection of plant diseases. With the significant advancement of technology, one of the simplest and most cost-effective methods for assessing plant health is through image-based data. A common approach for analyzing such data involves the use of deep convolutional neural networks (CNNs). However, due to the computationally intensive nature of these networks, deploying them on edge devices is often challenging and costly. In this work, we propose a dynamic knowledge distillation framework that transfers knowledge from a powerful teacher model based on ResNet-50 to a compact student model built upon ResNet-18. This framework adaptively regulates the strength of knowledge distillation based on simulated noise levels during training, improving robustness under diverse conditions without requiring explicit noise estimation at inference. Experiments conducted on the PlantDoc dataset demonstrate that our method improves the student model’s accuracy from 61.86% to 65.25%, which is 2.11% higher than the teacher model’s accuracy, while reducing the student model's size by 47.2 MB compared to the teacher. The proposed approach provides a practical solution for real-time and on-device plant disease diagnosis.
Papers List
List of archived papers
Frame Classification in Video Capsule Endoscopy Using an Improved Capsule Network
Amirhossein Ghaemi - Habibollah Danyali - Alireza Ghaemi
Extreme Gradient Boosting (XGBoost) Regressor and Shapley Additive Explanation for Crop Yield Prediction in Agriculture
Dennis A/L Mariadass - Ervin Gubin Moung - Maisarah Mohd Sufian - Ali Farzamnia
TriMAE: Fashion visual search with Triplet Masked Auto Encoder Vision Transformer
Lachin Zamani - Reza Azmi
An Attention-Based Model for Clinical Time Series Prediction: Enhancing ICU Readmission Prediction
Hananeh Sadat Madinei - Mohammad Reza Keyvanpour - Seyed Vahab Shojaedini
Machine and Deep Learning Models for Prediction of Small Molecule–Biotech Drug Pair’s Interactions
Fatemeh Nasiri - Mohsen Hooshmand
Intensity-Image Reconstruction Using Event Camera Data by Changing in LSTM Update
Arezoo Rahmati Soltangholi - Ahad Harati - Abedin Vahedian
A Survey of the AVOA Metaheuristic Algorithm and its Suitability for Power System Optimization and Damping Controller Design
Aliyu Sabo - Theophilus Ebuka Odoh - Samuel Habu - Hossien Shahinzadeh - Farshad Ebrahimi
Hardware-Efficient Pruned CNN Optimized by Neural Architecture Search and Genetic Algorithm for Diabetic Retinopathy Detection on STM32F746
Omid Askari Haddad - Sara Ershadi-Nasab
HV-RCE: Reducing Network Bandwidth Usage for Video Transmission via HEVC/VVC Features in Resource-Constrained Environments
Yaghoub Saberi - Mohammadreza Forghani - Sharifeh Sadat Mirkhalaf
Vision-Based Obstacle Avoidance in Drone Navigation using Deep Reinforcement Learning
Pooyan Rahmanzadeh Gervi - Ahad Harati - Sayed Kamaledin Ghiasi-Shirazi
more
Samin Hamayesh - Version 46.0.2