Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Do as I mean, not as I say: Sequence Loss Training for Spoken Language
  Understanding   Spoken language understanding (SLU) systems extract transcriptions, as well
as semantics of intent or named entities from speech, and are essential
components of voice activated systems. SLU models, which either directly
extract semantics from audio or are composed of pipelined automatic speech
recognition (ASR) and natural language understanding (NLU) models, are
typically trained via differentiable cross-entropy losses, even when the
relevant performance metrics of interest are word or semantic error rates. In
this work, we propose non-differentiable sequence losses based on SLU metrics
as a proxy for semantic error and use the REINFORCE trick to train ASR and SLU
models with this loss. We show that custom sequence loss training is the
state-of-the-art on open SLU datasets and leads to 6% relative improvement in
both ASR and NLU performance metrics on large proprietary datasets. We also
demonstrate how the semantic sequence loss training paradigm can be used to
update ASR and SLU models without transcripts, using semantic feedback alone.

24
The categories of this paper are: dg-ga
5
The categories of this paper are: gr-qc
31
The categories of this paper are: ao-sci
32
The categories of this paper are: atom-ph
36
The categories of this paper are: cmp-lg
11
The categories of this paper are: hep-lat
18
The categories of this paper are: econ
30
The categories of this paper are: q-alg
29
The categories of this paper are: funct-an
4
The categories of this paper are: cond-mat
20
The categories of this paper are: acc-phys
12
The categories of this paper are: nucl-th
3
The categories of this paper are: physics
33
The categories of this paper are: plasm-ph
17
The categories of this paper are: q-fin
28
The categories of this paper are: alg-geom