International Conference on Computer and Knowledge Engineering

Home / 12th International Conference on Computer and Knowledge Engineering

Deep Deterministic Policy Gradient in Acoustic To Articulatory inversion

Authors :

Farzane Abdoli¹ Hamid Sheikhzade² Vahid Pourahmadi³

1- Amirkabir university of technology 2- Amirkabir university of technology 3- Amirkabir university of technology

Keywords :

acoustic-to-articulatory inversion،DDPG،Reinforcement learning،Speaker-independent،MFCC

Abstract :

This paper aims to utilize a deep reinforcement learning algorithm for the acoustic-to-articulatory inversion problem. A deep deterministic policy gradient (DDPG) based method is adopted to adjust the articulatory parameters of a speaker to minimize the cepstral difference between original speech and the synthesized one. In traditional methods such as NNs, GMMs,... , parallel acoustic and articulatory training data is needed for each speaker, but the proposed iterative DDPG is used to explore articulatory space for finding the best point, which maximizes the desired reward without any need for joint kinematic and articulatory data for the speaker. Acoustic signals are synthesized by VocalTractLab(VTL), a three-dimensional articulatory synthesizer, and represented by Mel-frequency cepstral coefficients (MFCCs). This method provides estimated parameters very close to the ones which are calculated by MRI and advanced processing.

Papers List

List of archived papers

An intelligent linguistic error detection approach to automated diagnosis of Dyslexia disorder in Persian speaking children

Fatemeh Asghari - Mahsa Khorasani - Mohsen Kahani - Seyed Amir Amin Yazdi - Mahdi Arkhodi Ghalenoei

Graph Attention Networks for Modeling Multi-Sensor Relationships in Early Prediction of Critical Events in ICU Patients

Amir Akhavan Saffar - Danial Eskandari Faruji - Javad Hamidzadeh

HiCAP: Hierarchical Clustering-based Attention Pooling for Graph Representation Learning

Parsa Haddadian - Rooholah Abedian - Ali Moeini

Intracranial Hemorrhage Classification using CBAM Attention Module and Convolutional Neural Networks

Parnian Rahimi - Marjan Naderan - Amir Jamshidnezhad - Shahram Rafie

Disturbance Rejection in Quadruple-Tank System by Proposing New Method in Reinforcement Learning

Alireza Nezamzadeh - Mohammadreza Esmaeilidehkordi

LightFedSelect: A Lightweight Framework for Byzantine-Robust Federated Learning

Seyed Saeed Razavi - Seyed Arsalan Vasegh Rahim Parvar - Soroosh Dadashi Pakdeh - Mohammad Matin Rezaeifard - Morteza Mollaie Chafi - Reza Ebrahimi Atani

Classification of Audio Streaming in Network Traffic Based on Machine Learning Methods

Mohammad Nikbakht - Mehdi Teimouri

UAV-based Firefighting by Multi-agent Reinforcement Learning

Reza Shami Tanha - Mohsen Hooshmand - Mohsen Afsharchi

Optimizing Text-Based Protocol Clustering in Reverse Engineering with Auto-Encoders and Fine-Tuned Parameters

Shiva Mahmoudzadeh - Mohaddese Nemati - Mehdi Teimouri

Persian Legal Text Simplification Leveraging Transformer-Based Models

Mohammadreza Joneidi Jafari - Saedeh Tahery - Amirhossein Nikoofard