0% Complete
Home
/
11th International Conference on Computer and Knowledge Engineering
To Transfer or Not To Transfer (TNT): Action Recognition in Still Image Using Transfer Learning
Authors :
Ali Soltani Nezhad
1
Hojat Asgarian Dehkordi
2
Seyed Sajad Ashrafi
3
Shahriar Baradaran Shokouhi
4
1- School of Electrical Engineering, Iran University of Science and Technology, Tehran 16846-13144, Iran
2- School of Electrical Engineering, Iran University of Science and Technology, Tehran 16846-13144, Iran
3- School of Electrical Engineering, Iran University of Science and Technology, Tehran 16846-13144, Iran
4- School of Electrical Engineering, Iran University of Science and Technology, Tehran 16846-13144, Iran
Keywords :
Action Recognition, Still Image, Transfer Learning, Knowledge Distillation
Abstract :
Lack of training data and small datasets is one of the main challenges in human action recognition in still images. For this reason, training a network from scratch does not lead to good results just by using this little training data. Hence, many existing methods use the transfer learning techniques such as fine-tuning a pre-trained network with initial weights from ImageNet. It is important to note that some of the weights obtained from ImageNet are not suitable for human action recognition tasks. On the other hand, in fine-tuning the network, suitable initial weights for human action recognition may be changed. This paper proposes a method called To Transfer or Not To Transfer (TNT) based on knowledge distillation. In this method, a none trainable teacher with ImageNet weights is employed to train a light student network for action recognition tasks. In order to transfer relevant knowledge and not to transfer insufficient knowledge from teacher to student, a To Transfer or Not To Transfer Loss (TNTL) function is introduced in this paper. The proposed method is evaluated on Stanford 40 and Pascal VOC datasets, and the results show the superiority of this method over existing methods that exploit more parameters.
Papers List
List of archived papers
Improved TrustChain for Lightweight Devices
Seyed Salar Ghazi - Haleh Amintoosi
Energy Efficient Power Allocation in MIMO-NOMA Systems with ZF Receiver Beamforming in Multiple Clusters
Mahdi Nangir - Abdolrasoul Sakhaei Gharagezlou - Nima Imani
Deep Learning Feature Extraction for COVID-19 Detection Algorithm using Computerized Tomography Scan
Maisarah Mohd Sufian - Ervin Gubin Moung - Chong Joon Hou - Ali Farzamnia
Hate Sentiment Recognition System For Persian Language
Pegah Shams jey - Arash Hemmati - Ramin Toosi - Mohammad ali Akhaee
Analyzing the Impact of COVID-19 on Economy from the Perspective of User’s Reviews
Fatemeh Salmani - Hamed Vahdat-Nejad - Hamideh Hajiabadi
New Design of Efficient Reversible Quantum Saturation Adder
Negin Mashayekhi - Mohammad Reza Reshadinezhad - Shekoofeh Moghimi
Analysis of Address Lifespans in Bitcoin and Ethereum
Amir Mohammad Karimi Mamaghan - Amin Setayesh - Behnam Bahrak
Persis: A Persian Font Recognition Pipeline Using Convolutional Neural Networks
Mehrdad Mohammadian - Neda Maleki - Tobias Olsson - Fredrik Ahlgren
Efficient Vision Transformer for Accurate Traffic Sign Detection
Javad Mirzapour Kaleybar - Hooman Khaloo - Avaz Naghipour
Chaotic multi-population ABC algorithm based on memory and levy flight for solving dynamic job shop scheduling problems
Mohammad Ali Zarif - Javad Hamidzadeh
more
Samin Hamayesh - Version 41.7.6