0% Complete
Home
/
13th International Conference on Computer and Knowledge Engineering
BERT transformers Multitask learning Sarcasm and Sentiment classification (BMSS)
Authors :
Fatemeh Molavi
1
Jamshid Bagherzadeh Mohasefi
2
1- Urmia University
2- Supervisor
Keywords :
Sentiment Classification،Sarcasm Detection،Multi Task Learning،Transformers
Abstract :
Numerous researches were reported based on analyzing the sentiment of texts, which are becoming considerably vital to discover the sentiment in various domains of economic, marketing, politic, and etc. However, one of the most challenging aspects of Natural Language Processing (NLP) is discovery of the sarcasm. The sarcasm and the sentiment as similar subjects have been explored in various articles. In this research, two significant achievements were employed. Firstly, the pre-trained BERT transformer model was used to transfer its knowledge to our model. Then, fine tuned BERT model was combined with a machine learning approach, specifically Multitask learning (MTL). By establishing a connection between sarcasm and sentiment, we observed a simultaneous enhancement in both sarcasm detection and sentiment analysis performance. The achieved accuracy results (average of 0.97) were deemed satisfactory and commendable for both tasks.
Papers List
List of archived papers
A Smart Electrochemical Biosensor for Arsenic Detection in Water
Keyvan Asefpour Vakilian
Span-prediction of Unknown Values for Long-sequence Dialogue State Tracking
Marzieh Naghdi Dorabati - Reza Ramezani - Mohammad Ali Nematbakhsh
Pruning and Mixed Precision Techniques for Accelerating Neural Network
Mahsa Zahedi - Mohammad Sediq Abazari Bozhgani - Abdorreza Savadi
Semi-automatic Detection of Persian Stopwords using FastText Library
Mohammad Dehghani - Mohammad Manthouri
MIPS-Core Application Specific Instruction-Set Processor for IDEA Cryptography − Comparison between Single-Cycle and Multi-Cycle Architectures
Ahmad Ahmadi - Reza Faghih Mirzaee
Vaccine Distribution Modelling in Pandemics through Multi-Agent Systems: COVID-19 Case
Hossein Yarahmadi - Mohammad Ebrahim Shiri - Hamid Reza Navidi - Arash Sharifi - Moharram Challenger - Hassan Piriaei
Hate Sentiment Recognition System For Persian Language
Pegah Shams jey - Arash Hemmati - Ramin Toosi - Mohammad ali Akhaee
Maximum diffusion of news in social media with the approach of reducing the search space
Masoud Karian
PowerLinear Activation Functions with application to the first layer of CNNs
Kamyar Nasiri - Kamaledin Ghiasi-Shirazi
Adaptive Multi-Scale Attentional Network for Semantic Segmentation of Remote Sensing Images
Melika Zare - Sattar Hashemi
more
Samin Hamayesh - Version 41.5.3