Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Extending Text-to-Speech Synthesis with Articulatory Movement Prediction
  using Ultrasound Tongue Imaging   In this paper, we present our first experiments in text-to-articulation
prediction, using ultrasound tongue image targets. We extend a traditional
(vocoder-based) DNN-TTS framework with predicting PCA-compressed ultrasound
images, of which the continuous tongue motion can be reconstructed in synchrony
with synthesized speech. We use the data of eight speakers, train fully
connected and recurrent neural networks, and show that FC-DNNs are more
suitable for the prediction of sequential data than LSTMs, in case of limited
training data. Objective experiments and visualized predictions show that the
proposed solution is feasible and the generated ultrasound videos are close to
natural tongue movement. Articulatory movement prediction from text input can
be useful for audiovisual speech synthesis or computer-assisted pronunciation
training.

5
The categories of this paper are: gr-qc
14
The categories of this paper are: math-ph
9
The categories of this paper are: nlin
25
The categories of this paper are: patt-sol
4
The categories of this paper are: cond-mat
6
The categories of this paper are: astro-ph
2
The categories of this paper are: math
35
The categories of this paper are: mtrl-th
32
The categories of this paper are: atom-ph
37
The categories of this paper are: supr-con
20
The categories of this paper are: acc-phys
17
The categories of this paper are: q-fin
18
The categories of this paper are: econ
28
The categories of this paper are: alg-geom
12
The categories of this paper are: nucl-th
23
The categories of this paper are: solv-int