Please wait ...
0% Complete
Home
/
12th International Conference on Computer and Knowledge Engineering
SAT Based Analogy Evaluation Framework For Persian Word Embeddings
Authors :
Seyed Ehsan Mahmoudi
1
Mehrnoush Shamsfard
2
1- Computer Science and Engineering Department, Shahid Beheshti University, Tehran, Iran
2- Faculty of Computer Science and Engineering, Shahid Beheshti University
Keywords :
Analogy test،Semantic Similarity،Embedding Evaluation،Persian Langugae Processing
Abstract :
In recent years there has been a special interest in word embeddings as an approach to convert words to vectors. It has been a focal point to understand how much of the semantics of the words has been transferred into embedding vectors. Intrinsic evaluation of word embeddings is cheaper than evaluating them extrinsically and it is usually costly to evaluate the downstream application end-to-end in order to determine the quality of the used embedding model. Generally the word embeddings are evaluated through a number of tests, including analogy test. In this paper we propose a test framework for Persian embedding models. Persian is a low resource language and there is no rich semantic benchmark to evaluate word embedding models for this language. In this paper we introduce an evaluation framework including a hand crafted Persian SAT based analogy dataset, a colliquial test set (specific to Persian) and a benchmark to study the impact of various parameters on the semantic evaluation task.
Papers List
List of archived papers
A New Time Series Approach in Churn Prediction with Discriminatory Intervals
Hedieh Ahmadi - Seyed Mohammad Hossein Hasheminejad
The process of multi class fake news dataset generation
Sajjad Rezaei - Mohsen Kahani - Behshid Behkamal
Deep Deterministic Policy Gradient in Acoustic To Articulatory inversion
Farzane Abdoli - Hamid Sheikhzade - Vahid Pourahmadi
A Genetic-based Fusion Approach of Persian and Universal Phonetic results for Spoken Language Identification
Ashkan Moradi - Yasser Shekofteh - Saeed Zarei
Span-prediction of Unknown Values for Long-sequence Dialogue State Tracking
Marzieh Naghdi Dorabati - Reza Ramezani - Mohammad Ali Nematbakhsh
AIRSPAN-X: Federated XGBoost with Sequential Anomaly Detection for Explainable Urban Air Quality Prediction
Saghar Shafaati - S. Hossein Erfani
Machine and Deep Learning Models for Prediction of Small Molecule–Biotech Drug Pair’s Interactions
Fatemeh Nasiri - Mohsen Hooshmand
Delta-Audit: Explaining What Changes When Models Change
Arshia Hemmat - Afsane Fatemi
Adaptive Pattern Reconstruction Using Linear Regression for Improved TPS Anomaly Detection
Ali Azarsina - Alireza Safarzadeh - MohammadReza Jamali - Abdolhossein Vahabie
MIPS-Core Application Specific Instruction-Set Processor for IDEA Cryptography − Comparison between Single-Cycle and Multi-Cycle Architectures
Ahmad Ahmadi - Reza Faghih Mirzaee
more
Samin Hamayesh - Version 46.0.2