Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A General Multi-Task Learning Framework to Leverage Text Data for Speech
  to Text Tasks   Attention-based sequence-to-sequence modeling provides a powerful and elegant
solution for applications that need to map one sequence to a different
sequence. Its success heavily relies on the availability of large amounts of
training data. This presents a challenge for speech applications where labelled
speech data is very expensive to obtain, such as automatic speech recognition
(ASR) and speech translation (ST). In this study, we propose a general
multi-task learning framework to leverage text data for ASR and ST tasks. Two
auxiliary tasks, a denoising autoencoder task and machine translation task, are
proposed to be co-trained with ASR and ST tasks respectively. We demonstrate
that representing text input as phoneme sequences can reduce the difference
between speech and text inputs, and enhance the knowledge transfer from text
corpora to the speech to text tasks. Our experiments show that the proposed
method achieves a relative 10~15% word error rate reduction on the English
Librispeech task compared with our baseline, and improves the speech
translation quality on the MuST-C tasks by 3.6~9.2 BLEU.

27
The categories of this paper are: comp-gas
19
The categories of this paper are: eess
29
The categories of this paper are: funct-an
7
The categories of this paper are: hep-th
10
The categories of this paper are: q-bio
24
The categories of this paper are: dg-ga
6
The categories of this paper are: astro-ph
2
The categories of this paper are: math
37
The categories of this paper are: supr-con
25
The categories of this paper are: patt-sol
31
The categories of this paper are: ao-sci
16
The categories of this paper are: stat
12
The categories of this paper are: nucl-th
13
The categories of this paper are: quant-ph
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph