Please wait ...
0% Complete
Home
/
12th International Conference on Computer and Knowledge Engineering
Dual Memory Structure for Memory Augmented Neural Networks for Question-Answering Tasks
Authors :
Amir Bidokhti
1
Shahrokh Ghaemmaghami
2
1- Department of Electrical Engineering. Sharif University of Technology. Tehran, Iran
2- Sharif University of Technology
Keywords :
deep learning،memory augmented neural networks،graph neural networks،question-answering،neural Turing machine
Abstract :
Memory is crucial for machine learning tasks on sequential data. From vanilla RNN to LSTM and memory augmented neural networks, researchers have investigated several types of memory structures. However, they suffer from limitations in the capacity or ability to keep track of long-term dependencies. This paper presents an external memory module composed of two distinct submodules that are inspired by memory in the human brain. Besides, a sleep mechanism is incorporated into this memory, which can mimic sleep's effects on improving human memory. The proposed method is fully differentiable; thus, backpropagation can be used for its training. Experiments conducted on the bAbI dataset show that the proposed method is successful in 16 out of 20 tasks, and the average error is 2.8%. The performance of the proposed method is far better than the conventional NTM, and it has the lowest prediction error in 7 out of 20 tasks among baseline systems. Besides, the proposed system is the only system that can solve tasks 16 and 17 of the bAbI dataset.
Papers List
List of archived papers
Persian Legal Text Simplification Leveraging Transformer-Based Models
Mohammadreza Joneidi Jafari - Saedeh Tahery - Amirhossein Nikoofard
Collaborative LLM Reasoning for Vulnerability Detection in Smart Contracts
Amirreza Samari - Parsa Hedayatnia - Seyyed Javad Bozorgzadeh Razavi - Mohammad Allahbakhsh - Haleh Amintoosi
Joint ADC-less Analog Demodulator and Decoder for Extended Binary (8, 4, 4) Hamming Channel Code
Mir Mahdi Safari - Jafar Pourrostam - Behzad Mozaffari Tazehkand
VVC-AAR: Adaptive Attention-Aware Resolution and Residual Coding for Perceptually Optimized Ultra-Low Bitrate VVC Compression
Yaghoub Saberi - Somayeh Arab Najafabadi - Mohammadreza Hemmati
A Comparative Analysis of Clinical Note Categories for Mortality Prediction in ICU Patients
Maryam Karrabi - Mohsen Kahani - Mina Afzali - Nadieh Armin
WBT-GAN:Wavelet based Generative Adversarial Network for Texture Synthesis
Sara Saberi moghadam - Reza Azmi - Maral Zarvani
Investigation of topological characteristics of Iranian railway network: A network science approach
Sina Firuzbakht - Mohammad Khansari
Enhanced Hate Speech Detection Using Focal Loss and Multi-Head Attention for Imbalanced Social Media Text
Ali Rezazadeh - Hadi Shahriar Shahhoseini
Class-Aware Balanced Point Cloud Donwsampling for Efficient Large-Scale 3D Scene Understanding
Mohammad Yousefipour - Marjan Naderan - Morteza Jaderyan
Enhanced Skin Cancer Classification Using Deep Learning and Gradient Boosting Techniques
Amir Mohammad Sharafaddini - Najme Mansouri
more
Samin Hamayesh - Version 46.0.2