International Conference on Computer and Knowledge Engineering

Home / 12th International Conference on Computer and Knowledge Engineering

Span-prediction of Unknown Values for Long-sequence Dialogue State Tracking

Authors :

Marzieh Naghdi Dorabati¹ Reza Ramezani² Mohammad Ali Nematbakhsh³

1- Department of Computer Engineering, University of Isfahan 2- Dept. of Computer Engineering, University of Isfahan 3- Dept. of Computer Engineering, University of Isfahan

Keywords :

Task-oriented Dialogue Systems،Dialogue State Tracking،Unknown Values،Diversity of User Utterances،Long Sequences

Abstract :

Abstract—Dialogue state tracking is one of the main components in task-oriented dialogue systems whose duty is tracking the user goal during the conversation. Due to the diversity in natural languages and existing different utterances, the user requests may include unknown values at different turns in these systems. However, predicting true values of the user requests is necessary for completing the intended task. In existing studies, these values are determined using span-based methods to predict a span in utterances or previous dialogues. However, the slots are not correctly filled when values are multi-word. In addition, in some scenarios, the slot values in a given turn may depend on previously dialogue states. However, due to the limitation of the input length of language models, it is impossible to access all the previous dialogue states. In this study, a new approach is proposed that uses a span-tokenizer and adds the Bi-LSTM layer on top of the BERT model to predict the exact span of multi-word values. This approach uses parameters like user utterance, important dialogue histories, and all dialogue states as input to decrease the length of the sequences. The results show that this strategy has led to 1.80% improvement in the joint-goal accuracy and 0.15% improvement in the slot accuracy metrics over the MultiWOZ 2.1 dataset compared to the SAVN model.

Papers List

List of archived papers

Lightweight Local Transformer for COVID-19 Detection Using Chest CT Scans

Hojat Asgarian Dehkordi - Hossein Kashiani - Amir Abbas Hamidi Imani - Shahriar Baradaran Shokouhi

Variance-Guided Feature Correlation for Deep Full-Reference Image Quality Assessment

Amirreza Khakpour - Sina Yademellat - Azadeh Mansouri

Cloud Service Composition Using Genetic Algorithm and Particle Swarm Optimization

Javad Dogani - Farshad Khunjush

Adaptive Sliding Window Optimization for Multi-Dimensional Data Streams Using Reinforcement Learning

Abolfazl Zarghani

Efficient Object Detection using Deep Reinforcement Learning and Capsule Networks

Sobhan Siamak - Eghbal Mansoori

ExaAEC: A New Multi-label Emotion Classification Corpus in Arabic Tweets

Saeed Sarbazi-Azad - Ahmad Akbari - Mohsen Khazeni

An Advanced Dual Attention-based U-Net Using Breast Ultrasound Data for Image Segmentation

Erfan Akbarnezhad Sany - Niloufar Asghari - Fatemeh Naserizadeh - Seyyed Abed Hosseini

Brain Age Estimation with Twin Vision Transformer using Hippocampus Information Applicable to Alzheimer Dementia Diagnosis

Zahra Qodrati - Seyedeh Masoumeh Taji - Amirhossein Ghaemi - Habibollah Danyali - Kamran Kazemi - Alireza Ghaemi

HiCAP: Hierarchical Clustering-based Attention Pooling for Graph Representation Learning

Parsa Haddadian - Rooholah Abedian - Ali Moeini

Enhanced Melanoma Detection: An Improved Deformable DETR Model with Efficient Channel Attention

Amirreza Rouhbakhshmeghrazi - Shayan Nalbandian - Sheida Shadman - Mohammad Reza Hassannezhad - Shuyuan Yang - Bo Li