Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Leveraging Weakly Supervised Data to Improve End-to-End Speech-to-Text
  Translation   End-to-end Speech Translation (ST) models have many potential advantages when
compared to the cascade of Automatic Speech Recognition (ASR) and text Machine
Translation (MT) models, including lowered inference latency and the avoidance
of error compounding. However, the quality of end-to-end ST is often limited by
a paucity of training data, since it is difficult to collect large parallel
corpora of speech and translated transcript pairs. Previous studies have
proposed the use of pre-trained components and multi-task learning in order to
benefit from weakly supervised training data, such as speech-to-transcript or
text-to-foreign-text pairs. In this paper, we demonstrate that using
pre-trained MT or text-to-speech (TTS) synthesis models to convert weakly
supervised data into speech-to-translation pairs for ST training can be more
effective than multi-task learning. Furthermore, we demonstrate that a high
quality end-to-end ST model can be trained using only weakly supervised
datasets, and that synthetic data sourced from unlabeled monolingual text or
speech can be used to improve performance. Finally, we discuss methods for
avoiding overfitting to synthetic speech with a quantitative ablation study.

2
The categories of this paper are: math
18
The categories of this paper are: econ
21
The categories of this paper are: adap-org
33
The categories of this paper are: plasm-ph
25
The categories of this paper are: patt-sol
14
The categories of this paper are: math-ph
8
The categories of this paper are: hep-ex
11
The categories of this paper are: hep-lat
28
The categories of this paper are: alg-geom
22
The categories of this paper are: chao-dyn
4
The categories of this paper are: cond-mat
6
The categories of this paper are: astro-ph
32
The categories of this paper are: atom-ph
13
The categories of this paper are: quant-ph
20
The categories of this paper are: acc-phys
0
The categories of this paper are: hep-ph