Please wait ...
0% Complete
Home
/
14th International Conference on Computer and Knowledge Engineering
Optimizing Question-Answering Framework Through Integration of Text Summarization Model and Third-Generation Generative Pre-Trained Transformer
Authors :
Ervin Gubin Moung
1
Toh Sin Tong
2
Maisarah Mohd Sufian
3
Valentino Liaw
4
Ali Farzamnia
5
Farashazillah Yahya
6
1- Faculty of Computing and Informatics University Malaysia Sabah
2- Faculty of Computing and Informatics University Malaysia Sabah
3- Faculty of Computing and Informatics Universiti Malaysia Sabah
4- Faculty of Computing and Informatics Universiti Malaysia Sabah
5- School of Computing and Engineering University of Huddersfield
6- Faculty of Computing and Informatics Universiti Malaysia Sabah
Keywords :
Natural Language Processing (NLP)،Seq2Seq،Pre-Trained،Question-Answering Frameworks
Abstract :
This research project addresses the growing demand for efficient data access amidst the surge in digital information. Conventional keyword-based search engines face limitations, driving the exploration of advanced natural language processing (NLP) approaches. The study introduces an algorithm that autonomously extracts data from summary reports, utilizing NLP and information retrieval as a question-answering API. Evaluated using Recall-Oriented Understudy for Gisting Evaluation (ROUGE)-1, ROUGE-2, and ROUGE-L scores, PEGASUS achieved the highest average ROUGE score (0.432) with a single sample, while BART attained the highest multi-sample score (0.302) with 1000 samples. The research emphasized optimal hyperparameters in pre-trained models, specifically the impact of batch size on completion time and the relationship between maximum sequence length and ROUGE scores. By addressing limitations in integrating pre-trained models into Seq2Seq frameworks, the study aims to enhance question-answering solutions for more efficient information retrieval. The research contributes valuable insights to guide future developments in this field with improved efficiency and ROUGE scores.
Papers List
List of archived papers
Capturing Local and Global Features in Medical Images by Using Ensemble CNN-Transformer
Javad Mirzapour Kaleybar - Hooman Saadat - Hooman Khaloo
A Deep Reinforcement Learning Approach Combining Technical and Fundamental Analyses with a Large Language Model for Stock Trading
Mahan Veisi - Sadra Berangi - Mahdi Shahbazi Khojasteh - Armin Salimi-Badr
Crack Segmentation in Civil Structure Images Using a Deep Learning Based Multi-Classifier System
Mohammadreza Asadi - Seyedeh Sogand Hashemi - Mohammad Taghi Sadeghi
TriFuse-PdM: High-Fidelity Machine Failure Prediction Using Hybrid Resampling and Model Calibration
Saghar Shafaati - Javad Mohammadzadeh
An intelligent linguistic error detection approach to automated diagnosis of Dyslexia disorder in Persian speaking children
Fatemeh Asghari - Mahsa Khorasani - Mohsen Kahani - Seyed Amir Amin Yazdi - Mahdi Arkhodi Ghalenoei
A routing method with the approach of reducing energy consumption in WSNs with the Jellyfish Search (JS) optimizer algorithm and unequal clustering
Ehsan Gholami - Javad Hamidzadeh
Implementation of a Low-Overhead 2-Bit Parity-Preserving Reversible Vedic Multiplier for Quantum Architectures
Shekoofeh Moghimi - Negin Mashayekhi - Mohammad Reza Reshadinezhad
Identifying novel disease genes based on protein complexes and biological features
Mahshad Hashemi - Eghbal Mansoori
DEW-WIN: A Dynamic Energy-aware Window-based Scheduler for Mixed-criticality Systems
Mahin Moradiyan - Yasser Sedaghat - Pouria Hosseini - Yousef Rezazadeh
Lempel-Ziv-based Hyper-Heuristic Solution for Longest Common Subsequence Problem
Mahdi Nasrollahi - Reza Shami Tanha - Mohsen Hooshmand
more
Samin Hamayesh - Version 46.0.2