Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Improving Unsupervised Sparsespeech Acoustic Models with Categorical
  Reparameterization   The Sparsespeech model is an unsupervised acoustic model that can generate
discrete pseudo-labels for untranscribed speech. We extend the Sparsespeech
model to allow for sampling over a random discrete variable, yielding
pseudo-posteriorgrams. The degree of sparsity in this posteriorgram can be
fully controlled after the model has been trained. We use the Gumbel-Softmax
trick to approximately sample from a discrete distribution in the neural
network and this allows us to train the network efficiently with standard
backpropagation. The new and improved model is trained and evaluated on the
Libri-Light corpus, a benchmark for ASR with limited or no supervision. The
model is trained on 600h and 6000h of English read speech. We evaluate the
improved model using the ABX error measure and a semi-supervised setting with
10h of transcribed speech. We observe a relative improvement of up to 31.4% on
ABX error rates across speakers on the test set with the improved Sparsespeech
model on 600h of speech data and further improvements when we scale the model
to 6000h.

16
The categories of this paper are: stat
36
The categories of this paper are: cmp-lg
21
The categories of this paper are: adap-org
35
The categories of this paper are: mtrl-th
10
The categories of this paper are: q-bio
30
The categories of this paper are: q-alg
4
The categories of this paper are: cond-mat
34
The categories of this paper are: chem-ph
22
The categories of this paper are: chao-dyn
24
The categories of this paper are: dg-ga
5
The categories of this paper are: gr-qc
29
The categories of this paper are: funct-an
17
The categories of this paper are: q-fin
23
The categories of this paper are: solv-int
20
The categories of this paper are: acc-phys
14
The categories of this paper are: math-ph