0% Complete
Home
/
14th International Conference on Computer and Knowledge Engineering
Towards Efficient Capsule Networks through Approximate Squash Function and Layer-wise Quantization
Authors :
Mohsen Raji
1
Kimia Soroush
2
Amir Ghazizadeh
3
1- Shiraz university
2- Shiraz university
3- Shiraz university
Keywords :
Capsule Networks،Accelerated Squash Function،Post-Training Quantization،Quantization optimization
Abstract :
Capsule networks (CapsNets) have emerged as a promising architecture for various machine learning tasks due to their ability to capture hierarchical relationships within data. However, this structure has computationally intensive operations, particularly in the squash function, which involves square root calculations. In addition, they consume a lot of memory due to the high number of parameters, which makes them difficult to deploy on resource-constrained devices. In this paper, we take advantages of approximate computing and quantization to improve the efficiency of CapsNets performance. An approximate squash function is proposed using on the Fast Inverse Square Root (FISR) algorithm to accelerate square root operations, offering a remarkable speedup of up to 4 times compared to conventional methods. Additionally, we propose a novel algorithm called Least Sensitive Layer First (LSLF) in order to reduce the memory consumption of CapsNets. LSLF prioritizes aggressive quantization of the most error-tolerant layers while moderately quantizing the least sensitive layers against quantization error. Our experimental results demonstrate the effectiveness LSLF in enhancing the efficiency and performance of CapsNets, paving the way for more scalable and resource-efficient deep learning systems.
Papers List
List of archived papers
An Ensemble CNN for Brain Age Estimation based on Hippocampal Region Applicable to Alzheimer's Diagnosis
Zahra Qodrati - Seyedeh Masoumeh Taji - Habibollah Danyali - Kamran Kazemi
Adaptive-A-GCRNN: Enhancing Real-time Multi-band Spectrum Prediction through Attention-based Spatial-Temporal Modeling
Seyed majid Hosseini - Seyedeh Mozhgan Rahmatinia - Seyed Amin Hosseini Seno - Hadi Sadoghi yazdi
Energy-Aware Dynamic Digital Twin Placement in Mobile Edge Computing
Mahdi Hematyar - Zeinab Movahedi
Innovative Customer Segmentation based on Multi-Step Sequential Deep Clustering in the Telecommunication Industry
Fatemeh Jalali Farahani - Shima Tabibian
Introducing E4MT and LMBNC: Persian pre-processing utilities
Zakieh Shakeri - Mehran Ziabary - Behrooz Vedadian - Fatemeh Azadi - Saeed Torabzadeh - Arian Atefi
Smart Home Connectivity: Identifying the Best IoT Application Layer Protocols
Hossein Shahinzadeh - Zohreh Azani - Sundus F. Al-Hameedawi - S. Mohammadali Zanjani - Saiedeh Mehrabani-Najafabadi - Mohammadreza Hemmati
Assessing Users' Influence on Respondents in Conversation Quality: A Quantitative Study on Reddit Based on the Cooperative Principle
Afsaneh Habibi - Fattaneh Taghiyareh
Adversarial Robustness Evaluation with Separation Index
Bahareh Kaviani Baghbaderani - Afsaneh Hasanebrahimi - Ahmad Kalhor - Reshad Hosseini
Degarbayan-SC: A Colloquial Paraphrase Farsi Subtitles Dataset
Mohammad Javad Aghajani - Mohammad Ali Keyvanrad
An optimal workflow scheduling method in cloud-fog computing using three-objective Harris-Hawks algorithm
Ahmadreza Montazerolghaem - Maryam Khosravi - Fatemeh Rezaee
more
Samin Hamayesh - Version 42.2.1