International Conference on Computer and Knowledge Engineering

Home / 14th International Conference on Computer and Knowledge Engineering

Supervised Contrastive Learning for Short Text Classification in Natural Language Processing

Authors :

Mitra Esmaeili¹ Hamed Vahdat nejad²

1- Perlab, Faculty of Electrical and Computer Engineering, University of Birjand, Birjand, Iran 2- Perlab, Faculty of Electrical and Computer Engineering, University of Birjand, Birjand, Iran

Keywords :

Supervised Contrastive Learning،Text Classification،Natural Language Processing،Semantic Understanding

Abstract :

In recent years, the swift progress in information retrieval technologies has positioned text classification as a key area of research. Classifying short texts represents a major challenge within the domain of natural language processing. Given the growing prevalence of social media during critical events like hurricanes, accurately categorizing these texts is essential for facilitating evaluation and relief operations. Tweets, characterized by their conciseness and informal tone, present unique challenges for effective classification. Supervised contrastive learning has recently gained prominence as a powerful machine learning method, offering significant improvements over traditional approaches, particularly in the NLP field. This paper introduces a supervised contrastive learning strategy designed to enhance the precision of short text classification while maintaining the model’s generalization capability. Our approach consistently surpasses existing state-of-the-art techniques, delivering better accuracy and stability across a range of NLP tasks.

Papers List

List of archived papers

Multi-Digit Handwritten Recognition: A CNN-LSTM Hybrid Approach with Wavelet Transforms

Amin Kazempour - Jafar Tanha

Improving Motor Imagery Classification in BCI Systems Using EMD and Multi-Layer CNNs

Reza Arghand - Ali Chaibakhsh - Moein Radman

Attentional Bi-LSTM for Multivariate Time Series Forecasting on Edge Devices: A Case Study on NanoPi Neo Plus2

Navid Hajizadeh - Saeed Yazdani - Sara Ershadi-Nasab

Multi-Layered Defense Against Modern Phishing: A Dual-Sandbox and CDR Approach

Mahdi Seyfipoor - Mohammad Mahdi Eskandari

Using Deep Learning for Classification of Lung Cancer on CT Images in Ardabil Province

Mohammad Ali Javadzadeh Barzaki - Jafar Abdollahi - Mohammad Negaresh - Maryam Salimi - Hadi Zolfeghari - Mohsen Mohammadi - Asma Salmani - Rona Jannati - Firouz Amani

FedBrain-Distill: Communication-Efficient Federated Brain Tumor Classification Using Ensemble Knowledge Distillation on Non-IID Data

Rasoul Jafari Gohari - Laya Aliahmadipour - Ezat Valipour

Automated software design using Machine Learning With Natural Language Processing

Fahimeh Khedmatkon - Seyed Mohammad Hossein Hasheminejad - Jaleh Shoshtarian Malak

Leveraging Self-Supervised Models for Automatic Whispered Speech Recognition

Aref Farhadipour - Homa Asadi - Volker Dellwo

Introducing Meta-Contrastive Adaptive Autoencoder to Tackle Cold-Start Challenges in Sparse Domains

Hossein Rashid - Erfan Arzhmand - Fatemeh Hosseini

Investigation of topological characteristics of Iranian railway network: A network science approach

Sina Firuzbakht - Mohammad Khansari