Please wait ...
0% Complete
Home
/
14th International Conference on Computer and Knowledge Engineering
Towards Efficient Capsule Networks through Approximate Squash Function and Layer-wise Quantization
Authors :
Mohsen Raji
1
Kimia Soroush
2
Amir Ghazizadeh
3
1- Shiraz university
2- Shiraz university
3- Shiraz university
Keywords :
Capsule Networks،Accelerated Squash Function،Post-Training Quantization،Quantization optimization
Abstract :
Capsule networks (CapsNets) have emerged as a promising architecture for various machine learning tasks due to their ability to capture hierarchical relationships within data. However, this structure has computationally intensive operations, particularly in the squash function, which involves square root calculations. In addition, they consume a lot of memory due to the high number of parameters, which makes them difficult to deploy on resource-constrained devices. In this paper, we take advantages of approximate computing and quantization to improve the efficiency of CapsNets performance. An approximate squash function is proposed using on the Fast Inverse Square Root (FISR) algorithm to accelerate square root operations, offering a remarkable speedup of up to 4 times compared to conventional methods. Additionally, we propose a novel algorithm called Least Sensitive Layer First (LSLF) in order to reduce the memory consumption of CapsNets. LSLF prioritizes aggressive quantization of the most error-tolerant layers while moderately quantizing the least sensitive layers against quantization error. Our experimental results demonstrate the effectiveness LSLF in enhancing the efficiency and performance of CapsNets, paving the way for more scalable and resource-efficient deep learning systems.
Papers List
List of archived papers
Semi-Supervised Supply Chain Fraud Detection with Unsupervised Pre-Filtering
Fatemeh Moradi - Mehran Tarif - Mohammadhossein Homaei
Extreme Gradient Boosting (XGBoost) Regressor and Shapley Additive Explanation for Crop Yield Prediction in Agriculture
Dennis A/L Mariadass - Ervin Gubin Moung - Maisarah Mohd Sufian - Ali Farzamnia
Exploring 3D Transfer Learning CNN Models for Alzheimer’s Disease Diagnosis from MRI Images
Fatemehsadat Ghanadi Ladani - Hamidreza Baradaran Kashani
TrackMine: Topic Tracking in Model Mining using Genetic Algorithm
Mohammad Sajad Kasaei - Mohammadreza Sharbaf - Afsaneh Fatemi - Bahman Zamani
AIRSPAN-X: Federated XGBoost with Sequential Anomaly Detection for Explainable Urban Air Quality Prediction
Saghar Shafaati - S. Hossein Erfani
Fine-tuned Generative Adversarial Network-based Model for Medical Image Super-Resolution
Alireza Aghelan - Modjtaba Rouhani
Segmentation of Hard Exudates in Retinal Fundus Images Using BCDU-Net
Nafise Ameri - Nasser Shoeibi - Mojtaba Abrishami
Leveraging the Power of Object Detection Models in Identifying Litter for a Significant Reduction in Environmental Pollution
Lim Zhen Xian - Ervin Gubin Moung - Jason Teo Tze Wi - Nordin Saad - Farashazillah Yahya - Tiong Lin Rui - Ali Farzamnia
R2-BAC: A Novel Blockchain and IoT-Based Access Control Model for Supply Chain Management
Sadegh Sohani - Farnaz Kamranfar - Haleh Amintoosi - Mohammad Allahbakhsh
A New Hypercube Variant: Pruned Shuffle Connected Cube
Reza Latifi - Mahmoud Naghibzadeh
more
Samin Hamayesh - Version 46.0.2