Please wait ...
0% Complete
Home
/
13th International Conference on Computer and Knowledge Engineering
BERT transformers Multitask learning Sarcasm and Sentiment classification (BMSS)
Authors :
Fatemeh Molavi
1
Jamshid Bagherzadeh Mohasefi
2
1- Urmia University
2- Supervisor
Keywords :
Sentiment Classification،Sarcasm Detection،Multi Task Learning،Transformers
Abstract :
Numerous researches were reported based on analyzing the sentiment of texts, which are becoming considerably vital to discover the sentiment in various domains of economic, marketing, politic, and etc. However, one of the most challenging aspects of Natural Language Processing (NLP) is discovery of the sarcasm. The sarcasm and the sentiment as similar subjects have been explored in various articles. In this research, two significant achievements were employed. Firstly, the pre-trained BERT transformer model was used to transfer its knowledge to our model. Then, fine tuned BERT model was combined with a machine learning approach, specifically Multitask learning (MTL). By establishing a connection between sarcasm and sentiment, we observed a simultaneous enhancement in both sarcasm detection and sentiment analysis performance. The achieved accuracy results (average of 0.97) were deemed satisfactory and commendable for both tasks.
Papers List
List of archived papers
Low-Cost and Hardware Efficient Implementation of Pooling Layers for Stochastic CNN Accelerators
Mobin Vaziri - Hadi Jahanirad
Adaptive Channel Estimation for MIMO-OFDM Systems in Impulsive Noise Environments
Mojtaba Hajiabadi
Efficient Sub-Carrier Relationship Extraction for Human Activity Recognition via EEGNet in Wireless Sensing
Siavash Zaravashan - Sadegh ArefiZadeh - Sajjad Torabi
Early detection of Parkinson’s disease using Convolutional Neural Networks on SPECT images
Reyhaneh Dehghan - Marjan Naderan - Seyyed Enayatallah Alavi
Designing an IT2 Fuzzy Rule-based System for Emotion Recognition Using Biological Data
Mahsa Keshtkar - Hooman Tahayori
Graph-Theoretic Approach and Advanced Data Balancing for Liver Disease Diagnosis Improvement
Soheib Kiani - Sadegh Sulaimany
Developing Convolutional Neural Networks using a Novel Lamarckian Co-Evolutionary Algorithm
Zaniar Sharifi - Khabat Soltanian - Ali Amiri
Android Malware Detection using Supervised Deep Graph Representation Learning
Fatemeh Deldar - Mahdi Abadi - Mohammad Ebrahimifard
Binary Classification of Capuchin Bird Calls via Spectrogram-Enhanced Frequency-Aware Convolutional Neural Networks
Samad Najjar-Ghabel - Shamim Yousefi - Reza Danandeh Bileh Savar
Improving performance of multi-label classification using ensemble of feature selection and outlier detection
Mohammad Ali Zarif - Javad Hamidzadeh
more
Samin Hamayesh - Version 46.0.2