International Conference on Computer and Knowledge Engineering

Please wait ...

Home / 13th International Conference on Computer and Knowledge Engineering

BERT transformers Multitask learning Sarcasm and Sentiment classification (BMSS)

Authors :

Fatemeh Molavi¹ Jamshid Bagherzadeh Mohasefi²

1- Urmia University 2- Supervisor

Keywords :

Sentiment Classification،Sarcasm Detection،Multi Task Learning،Transformers

Abstract :

Numerous researches were reported based on analyzing the sentiment of texts, which are becoming considerably vital to discover the sentiment in various domains of economic, marketing, politic, and etc. However, one of the most challenging aspects of Natural Language Processing (NLP) is discovery of the sarcasm. The sarcasm and the sentiment as similar subjects have been explored in various articles. In this research, two significant achievements were employed. Firstly, the pre-trained BERT transformer model was used to transfer its knowledge to our model. Then, fine tuned BERT model was combined with a machine learning approach, specifically Multitask learning (MTL). By establishing a connection between sarcasm and sentiment, we observed a simultaneous enhancement in both sarcasm detection and sentiment analysis performance. The achieved accuracy results (average of 0.97) were deemed satisfactory and commendable for both tasks.

List of archived papers

An intelligent linguistic error detection approach to automated diagnosis of Dyslexia disorder in Persian speaking children

Fatemeh Asghari - Mahsa Khorasani - Mohsen Kahani - Seyed Amir Amin Yazdi - Mahdi Arkhodi Ghalenoei

A Facial Deepfake Detection Approach using CNN-based Models, Swin Transformer and Classifier Fusion

Alireza Honardoost - Mahdie Rahmati - Babak Nasersharif

A Novel Deformable Registration Method for Cerebral Magnetic Resonance Images

Bahareh Asadpour Dasht Bayaz - Mahdi Saadatmand - Fabrice Wallois

VVC-AAR: Adaptive Attention-Aware Resolution and Residual Coding for Perceptually Optimized Ultra-Low Bitrate VVC Compression

Yaghoub Saberi - Somayeh Arab Najafabadi - Mohammadreza Hemmati

Simulation-Based Data Augmentation for Apple Leaf Disease Using Statistical Moments and HSV Color Features

Seyedeh Maryam Moosavi - Morteza Gholipour - Yasser Baleghi

Deep Learning-Driven Beamforming Optimization for High-Performance 5G Planar Antenna Arrays

Rahman Mohammadi - Seyed Reza Razavi Pour

A Deep CNN Model Based Ensemble Approach for Semantic and Instance Segmentation of Indoor Environment

Sajad Rezaei - Jafar Tanha - Zahra Jafari - SeyedEhsan Roshan - Mohammad-Amin Memar Kochebagh

Hybrid navigation based on GPS data and SIFT-based place recognition using Biologically-inspired SLAM

Sahar Salimpour Kasebi - Hadi Seyedarabi - Javad Musevi Niya

Transformer-Gather, Fuzzy-Reconsider: A Scalable Hybrid Framework for Entity Resolution

Mohammadreza Sharifi - Danial Ahmadzadeh

Reversible Data Insertion in Encryption Domain Based on Reduced Quad Difference Expansion

Alireza Ghaemi - Mohammad Zare Ehteshami - Amirhossein Ghaemi

more

Samin Hamayesh - Version 44.9.3