International Conference on Computer and Knowledge Engineering

Home / 14th International Conference on Computer and Knowledge Engineering

Improve the utility of tensor cores by compacting sparse matrix technique

Authors :

Mohammad.S Abazari¹ Mahsa Zahedi² Abdorreza Savadi³

1- Ferdowsi university of mashhad 2- Ferdowsi university of mashhad 3- Ferdowsi university of mashhad

Keywords :

Tensor Cores،Neural Networks،Convolution Operations،Graphics Processing Unit

Abstract :

Neural networks have demanding computational requirements, particularly in matrix multiplication operations. To address this challenge, we propose a model that combines network pruning and matrix compression techniques. Our approach leverages NVIDIA's tensor cores, which excel at efficient matrix operations. We compress the network weights based on the tensor core structure and perform convolutions using the compressed weight matrix on the tensor cores. Our model incorporates neural network pruning, mixed-precision training, and compression of network weight tensors using the im2col algorithm and CSR format. We also utilize tensor kernels with a block size of 16x16 for multiplication. We evaluate the performance of various models, including pruned, AMP-optimized, combined pruning and AMP techniques, and our proposed model. Our evaluation reveals a significant improvement in performance compared to a simple baseline model. Through an extensive analysis of related works, we establish foundational concepts, present our proposed model, and share the obtained results.

Papers List

List of archived papers

BERT transformers Multitask learning Sarcasm and Sentiment classification (BMSS)

Fatemeh Molavi - Jamshid Bagherzadeh Mohasefi

Token-Based Access Control for Inter-organization Collaboration in Hyperldger Fabric

Parsa Hedayatnia - Mohammad Ata Jalilian - Mohammad Allahbakhsh - Haleh Amintoosi

Introducing E4MT and LMBNC: Persian pre-processing utilities

Zakieh Shakeri - Mehran Ziabary - Behrooz Vedadian - Fatemeh Azadi - Saeed Torabzadeh - Arian Atefi

Detecting Non-Spherical Clusters Using Modified CURE Algorithm

Arezou Safdari - Pedram Salehpour

An intelligent linguistic error detection approach to automated diagnosis of Dyslexia disorder in Persian speaking children

Fatemeh Asghari - Mahsa Khorasani - Mohsen Kahani - Seyed Amir Amin Yazdi - Mahdi Arkhodi Ghalenoei

Deep Learning-based Processing of Autonomous Vehicle Radar Data to Achieve High Resolution

Nima Abdolrahimi Shahamat - Vahideh Moghtadaiee - Esfandiar Mehrshahi

EfficientNetB0’s Hybrid Approach for Brain Tumor Classification from MRI Images Using Deep Learning and Bagging Trees

Yeganeh Modaresnia - Farhad Abedinzadeh Torghabeh - Seyyed Abed Hosseini

Soccer Video Event Detection Using Metric Learning

Ali Karimi - Ramin Toosi - Mohammad Ali Akhaee

Overview of Electric Vehicles Charging Stations in Smart Grids

Mohammed Wadi - Wisam Elmasry - Mohammed Jouda - Hossein Shahinzadeh - Gevork B. Gharehpetian

Adaptive Pronunciation Scoring: Aligning Automated Assessments with Human Expert Evaluations

Omid Aghdaei - Mohammad Sadegh Safari - Mohammad Hassan Rasoolizadeh - Abedeh Mirzaee