0% Complete
Home
/
14th International Conference on Computer and Knowledge Engineering
Enhancing Persian Word Sense Disambiguation with Large Language Models: Techniques and Applications
Authors :
Fatemeh Zahra Arshia
1
Saeedeh Sadat Sadidpour
2
1- Faculty of Electronic & Computer Engineering, Malek Ashtar University of Technology
2- Faculty of Electronic & Computer Engineering, Malek Ashtar University of Technology
Keywords :
Word Sense Disambiguation (WSD)،Large Language Models (LLMs)،Persian Disambiguation
Abstract :
WSD means the task of word sense disambiguation, which is a very important task in NLP. It assigns not only the meaningful word to the source text but also the proper meaning of the word according to the context. Hence, it is key to the proper accomplishment of NLP in Persian—a language rich in morphology and great polysemy. The recent improvements in LMs have greatly advanced the capabilities of NLP, opening further improvement avenues in WSD performance. This paper presents the integration of LLMs for improving WSD in Persian, considering the linguistic challenges related to this language. In this study, we consider four models of the Persian language: FaBERT, AriaBERT, GPT-2 Persian, and PersianMind-v1.0. We use the supervised fine-tuning method on the SBU-WSD-Corpus. Our methodology will consist of preprocessing the Persian WSD corpus, then fine-tuning the models with the mentioned corpus, and measuring their performance. Results indicate that methods using LLMs significantly improve WSD accuracy against traditional methods, with FaBERT achieving the best accuracy. We have further expounded on their real-life applications, such as sentiment analysis, to show the consequential effect of this advancement on general NLP tasks. The study is concluded with some insights into future research directions, underlining the potential role that LLMs can play in further transforming WSD and related fields.
Papers List
List of archived papers
Multi-source Ensemble Model for Scene Recognition
Amir Hossein Saleknia - Ahmad Ayatollahi
Low-Cost and Hardware Efficient Implementation of Pooling Layers for Stochastic CNN Accelerators
Mobin Vaziri - Hadi Jahanirad
FarSick: A Persian Semantic Textual Similarity And Natural Language Inference Dataset
Zahra Ghasemi - Mohammad Ali Keyvanrad
DIPT: Diversified Personalized Transformer for QAC systems
Mahdi Dehghani - Samira Vaez Barenji - Saeed Farzi
An Improved and Accurate Measure for Mining Correlated High-utility Itemsets
Amir Masoud Heidari Orojloo - Morteza Keshtkaran
GroupRec: Group Recommendation by Numerical Characteristics of Groups in Telegram
Davod Karimpour - Mohammad Ali Zare Chahooki - Ali Hashemi
Robat-e-Beheshti: A Persian Wake Word Detection Dataset for Robotic Purposes
Parisa Ahmadzadeh Raji - Yasser Shekofteh
A Novel Density-Based KNN in Pattern Recognition
Sajad Haghzad Klidbary - Abazar Arabameri
Multi-Digit Handwritten Recognition: A CNN-LSTM Hybrid Approach with Wavelet Transforms
Amin Kazempour - Jafar Tanha
Word-level Persian Lipreading Dataset
Javad Peymanfard - Ali Lashini - Samin Heydarian - Hossein Zeinali - Nasser Mozayani
more
Samin Hamayesh - Version 42.4.1