Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Improved Prosody from Learned F0 Codebook Representations for VQ-VAE
  Speech Waveform Reconstruction   Vector Quantized Variational AutoEncoders (VQ-VAE) are a powerful
representation learning framework that can discover discrete groups of features
from a speech signal without supervision. Until now, the VQ-VAE architecture
has previously modeled individual types of speech features, such as only phones
or only F0. This paper introduces an important extension to VQ-VAE for learning
F0-related suprasegmental information simultaneously along with traditional
phone features.The proposed framework uses two encoders such that the F0
trajectory and speech waveform are both input to the system, therefore two
separate codebooks are learned. We used a WaveRNN vocoder as the decoder
component of VQ-VAE. Our speaker-independent VQ-VAE was trained with raw speech
waveforms from multi-speaker Japanese speech databases. Experimental results
show that the proposed extension reduces F0 distortion of reconstructed speech
for all unseen test speakers, and results in significantly higher preference
scores from a listening test. We additionally conducted experiments using
single-speaker Mandarin speech to demonstrate advantages of our architecture in
another language which relies heavily on F0.

36
The categories of this paper are: cmp-lg
29
The categories of this paper are: funct-an
3
The categories of this paper are: physics
8
The categories of this paper are: hep-ex
10
The categories of this paper are: q-bio
7
The categories of this paper are: hep-th
4
The categories of this paper are: cond-mat
16
The categories of this paper are: stat
35
The categories of this paper are: mtrl-th
0
The categories of this paper are: hep-ph
33
The categories of this paper are: plasm-ph
13
The categories of this paper are: quant-ph
31
The categories of this paper are: ao-sci
21
The categories of this paper are: adap-org
37
The categories of this paper are: supr-con
11
The categories of this paper are: hep-lat