0% Complete
Home
/
14th International Conference on Computer and Knowledge Engineering
Towards Efficient Capsule Networks through Approximate Squash Function and Layer-wise Quantization
Authors :
Mohsen Raji
1
Kimia Soroush
2
Amir Ghazizadeh
3
1- Shiraz university
2- Shiraz university
3- Shiraz university
Keywords :
Capsule Networks،Accelerated Squash Function،Post-Training Quantization،Quantization optimization
Abstract :
Capsule networks (CapsNets) have emerged as a promising architecture for various machine learning tasks due to their ability to capture hierarchical relationships within data. However, this structure has computationally intensive operations, particularly in the squash function, which involves square root calculations. In addition, they consume a lot of memory due to the high number of parameters, which makes them difficult to deploy on resource-constrained devices. In this paper, we take advantages of approximate computing and quantization to improve the efficiency of CapsNets performance. An approximate squash function is proposed using on the Fast Inverse Square Root (FISR) algorithm to accelerate square root operations, offering a remarkable speedup of up to 4 times compared to conventional methods. Additionally, we propose a novel algorithm called Least Sensitive Layer First (LSLF) in order to reduce the memory consumption of CapsNets. LSLF prioritizes aggressive quantization of the most error-tolerant layers while moderately quantizing the least sensitive layers against quantization error. Our experimental results demonstrate the effectiveness LSLF in enhancing the efficiency and performance of CapsNets, paving the way for more scalable and resource-efficient deep learning systems.
Papers List
List of archived papers
Extracting Major Topics of COVID-19 Related Tweets
Faezeh Azizi - Hamed Vahdat-Nejad - Hamideh Hajiabadi - Mohammad Hossein Khosravi
Enhanced Autoencoder-based Clustering for Message Analysis in Binary Protocols
Mohaddese Nemati - Shiva Mahmoudzadeh - Mehdi Teimouri
Assessing Users' Influence on Respondents in Conversation Quality: A Quantitative Study on Reddit Based on the Cooperative Principle
Afsaneh Habibi - Fattaneh Taghiyareh
Adaptive Multi-Scale Attentional Network for Semantic Segmentation of Remote Sensing Images
Melika Zare - Sattar Hashemi
Blind Load-Balancing Algorithm using Double-Q-learning in the Fog Environment
Niloofar Tahmasebi pouya - Mehdi Agha Sarram
Emotion Recognition In Persian Speech Using Deep Neural Networks
Ali Yazdani - Hossein Simchi - Yasser Shekofteh
Multi-source Ensemble Model for Scene Recognition
Amir Hossein Saleknia - Ahmad Ayatollahi
Identifying novel disease genes based on protein complexes and biological features
Mahshad Hashemi - Eghbal Mansoori
Soccer Video Event Detection Using Metric Learning
Ali Karimi - Ramin Toosi - Mohammad Ali Akhaee
R2-BAC: A Novel Blockchain and IoT-Based Access Control Model for Supply Chain Management
Sadegh Sohani - Farnaz Kamranfar - Haleh Amintoosi - Mohammad Allahbakhsh
more
Samin Hamayesh - Version 41.5.3